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INTERNATIONA!  COOPERATIVE 
RESEARCH  AND  DEVELOPMENT 
PROGRAMS 

MealMlodf 


From  a  review  of  the  literature  and  more  than  30  interviews  from  those  who 
work  on  International  Cooperative  Research  and  Development  Programs 
comes  a  wealth  of  theoretical  and  practical  advice  on  how  to  help  these 
often  logistically,  politically,  and  economically  complex  projects  succeed. 


Before  undertaking  an  international 
cooperative  research  and  develop¬ 
ment  program  (ICRAD),  where  does 
a  program  manager  go  to  find  guidance  on 
what  to  do  and  what  to  avoid  doing?  There 
is  a  dearth  of  published  data  in  this  area, 
although  some  unpublished  documents 
created  for  internal  use  do  exist. 

The  study  described  here  set  out  to 
answer  that  question.  It  consisted  of 
research  of  the  available  literature  as  well 
as  interviews  with  32  people  from  the 
Defense  Department,  industry,  and  foreign 
military  departments  who  work  on 
ICRADs  (defined  as  programs  developed 
cooperatively  by  two  or  more  nations  in 
which  the  design  or  technical  effort  and 
the  costs  are  shared  by  those  nations).  The 
aim  was  to  obtain  a  cross-section  of 
perspectives  and  cover  a  full  range  of 


factors  relevant  to  ICRADs.  With  the 
addition  of  the  author,  the  interviewees  had 
more  than  400  years  of  international 
experience  out  of  a  total  of  more  than  800 
years  of  overall  work  and  acquisition 
experience;  this  is  an  average  of  more  than 
12  years  international  and  24  years  over¬ 
all  experience  per  person.  Most  of  this 
experience  was  with  North  Atlantic  Treaty 
Organization  (NATO)  programs. 

While  the  data  is  anecdotal,  a  large 
enough  sampling  was  sought  to  provide  a 
comprehensive  overview.  The  research 
objective  was  to  elicit  frank  comments  and 
suggestions  from  experienced  people  that 
can  be  used  by  others  to  establish  and 
implement  current  and  future  ICRADs.  All 
interviewees  were  guaranteed  anonymity 
(and  unattributed  quotes  in  this  article  are 
from  interviewees).  , 
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WhyCooperati? 


The  Report  of  the  Quadrennial  Defense 
Review  (Cohen,  1997)  states  that  “we  as 
a  nation  must  often  act  in  concert  with 
others  to  create  our  preferred  international 
conditions  and  secure  our  basic  national 
goals.  ...Therefore,  it  is  imperative  that 
the  United  States  strives  to  build  close, 
cooperative  relations  with  the  world’s 
most  influential  countries.”  Furthermore, 
“To  maintain  this  superiority,  we  must 
achieve  a  new  level  of  proficiency  in  our 
ability  to  conduct  joint  and  combined 
operations... The  RBA  [Revolution  in 
Business  Affairs]  includes... increasing 
cooperative  development  programs  with 


allies.”  For  instance,  the  Navy  reports  a 
trend  toward  increased  cooperation  during 
the  past  decade  (Figure  1)  (Navy  Interna¬ 
tional  Programs  Office  [NIPO],  1997).  To 
the  trend  toward  coalition  warfare,  Abbott 
(1997)  adds  the  advantages  of  standard¬ 
ization,  interoperability,  common  logistics, 
and  the  reduced  defense  budget  as  reasons 
for  a  greater  mandate  for  cooperation. 

The  decreasing  budget  has  resulted  in 
a  steady  decline  in  government  research 
and  development  (R&D)  expenditures 
relative  to  industry  (NIPO,  1997).  The 
State  Department  points  out  that  “the 
perception  that  we  are  withdrawing 
physically  and  psychologically  under¬ 
cuts  Germany’s  essential  interest  in  our 
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Total  Foreign  Contributions  CY 1990-1998:  $1867.62  Million 

Source:  Navy  International  Programs  Office  (1997).  As  of  October  13, 1998 


Figure  1.  Department  ef  the  Nmry  Cellaberathre  Effert  frends 
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security  relationship,  which  allows  it  to 
pursue  a  pan-European  agenda  without 
appearing  to  threaten  the  rest  of  Europe. 
It  also  undercuts  our  interest  in  moving 
the  bilateral  relationship  in  directions  that 
will  positively  aifect  outcomes  in  and  be¬ 
yond  Europe”  (Jones,  1997).  Technologi¬ 
cally,  information  warfare,  operations 
other  than  war  (OOTW),  and  the  global 
simulation  network  present  unique  chal¬ 
lenges  best  met  globally,  in  concert  with 
our  friends  and  allies.  Politically,  ICRADs 
promote  allied  industrial  bases,  help  al¬ 
lies  defend  themselves,  and  strengthen 
coalitions  to  forestall  the  establishment  of 
“Fortress  Europe”  and  “Fortress  America.” 
As  President  Bill  Clinton  (1997)  observed, 
“the  United  States  squandered  Allied  vic¬ 
tory  in  World  War  I  when  it  embraced  iso¬ 
lationism.”  In  today’s  global  economy, 
commercial  international  programs  are  im¬ 
portant  to  America’s  well-being,  especially 


as  the  U.S.  defense  industry  consolidates 
through  mergers  and  acquisitions  (Dalton, 
1997)  (Figure  2  [Abbott,  1997]).  Thus, 
Department  of  Defense  Directive  (DoDD) 
5000,  Joint  Vision  2010  (Shalikashvili, 
1997),  and  ihc  National  Military  Strategy 
of  the  U.S  A.  (Shalikashvili,  1997)  all  lend 
considerable  support  to  ICRADs.  In  the 
words  of  one  foreign  interviewee, 
“America  is  a  European  power.” 

Why  Nor? 


Cooperation  has  had  “more  starts  than 
finishes”  (Abbott,  1997),  leading  to  pres¬ 
sure  for  pan-European  versus  transatlan¬ 
tic  cooperation  (D’Agostino,  1996).  While 
many  reasons  for  failure  have  been  cited 
(e.g.,  program  selection,  poor  timing,  lack 
of  training),  many  Americans  perceive  that 
the  U.S.  system  is  highly  problematic 


Figure  2.  Grourth  in  Industry-Led  International  Cooperation 


219 


Aiquishion  liemw  QuarferfySummer  1999 


(Kwatnoski,  1995)  and  that  ICRADs  add 
risk  to  program  managers  without  com¬ 
pensatory  advantages  (Deputy  Undersec¬ 
retary  of  Defense  for  International  and 
Commercial  Programs,  or  DUSD[I&CP], 
1997).  Of  course,  these  reasons  do  not 
address  the  nonrational  or  irrational  effects 
of  “not  invented  here,”  xenophobia,  and 
cultural  differences. 


Hisromr 


ICI^ 


faMllinapMlrfiMy/ 


The  DoD  Authorization  Act  of  1986 
initiated  the  NATO  Cooperative  R&D 
Program  to  promote  more  equitable  shar¬ 
ing  of  NATO 
conventional  re¬ 
search  and  de¬ 
velopment  costs 
via  cooperative 
projects.  Con¬ 
gress  believed 
that  the  Warsaw 
Pact  was  more 
cost  effective  than  NATO  due  to  lack  of 
NATO  cooperation  (General  Accounting 
Office,  1990).  Congress  appropriated 
“Nunn  funds.”  Proposed  by  Senator  Sam 
Nunn,  “Nunn”  funds  are  annually  bud¬ 
geted  by  Congress  as  a  special  fund  (in 
four  sub-accounts  for  the  three  services 
and  the  Office  of  the  Secretary  of  Defense 
[OSD])  to  be  used  as  seed  money  to  begin 
ICRADS.  These  funds  can  only  be  spent 
in  the  United  States.  Congress  later  added 


five  non-NATO  nations  (Australia,  Egypt, 
Israel,  Japan,  and  South  Korea,  later 
followed  by  two  more,  Argentina  and 
Jordan).  Similarly,  legislative  relief  (but 
not  funds)  was  provided  for  cooperative 
production  projects.  Nevertheless,  no  co¬ 
operative  program  has  proceeded  through 


R&D,  coproduction,  and  operations  and 
support  thus  far.  DoDD  5000.1  (1996),  the 
acquisition  “Bible,”  lists  cooperation  sec¬ 
ond  (after  purely  commercial  products  and 
above  joint  programs)  in  its  ordered  hier¬ 
archy  of  materiel  alternatives.  In  addition, 
DoD  sponsors  numerous  other  programs 
(such  as  a  data  exchange  annex,  or  DEA) 
that  could,  in  theory,  develop  into 
ICRADs. 

In  the  past,  however,  programs  chosen 
as  ICRADs  tended  to  be  noncritical,  low 
priority,  poorly  funded  ones.  Nunn  funds 
would  be  used  to  cover  startup  costs  for 
programs  that  did  not  make  Service  fund¬ 
ing  lists,  and  they  could  easily  die  when 
the  Nunn  funds  ran  out.  International  com¬ 
mitments  that  did  not  (in  the  Service’s 
opinion)  critically  support  war  fighting 
requirements  lost  out  in  competitive  Ser¬ 
vice  program  objectives  memorandums 
(POMs).  In  other  words,  tactical  support 
to  marginal  or  fringe  programs  was  insuf¬ 
ficient  to  ensure  their  continuity  when 
unsupported  at  the  operational  level.  Even 
“strategic”  generic  support  to  ICRADs  by 
the  DUSD(I&CP)  could  only  save  a  few 
select  projects  (the  fate  of  one  of  these, 
the  mobile  extended  air  defense  system, 
or  MEADS,  is  still  in  question).  In  addi¬ 
tion,  entrenched  bureaucracies,  with  their 
own  agendas,  made  no  concessions  to 
ICRADs  versus  domestic  projects  despite 
ICRADs’  inherent,  added  administrative 
burdens  (e.g.,  memorandum  of  under¬ 
standing  [MOU]  development  and  nego¬ 
tiation).  To  top  it  off,  the  bureaucracy 
“moves  with  the  speed  of  a  dead  snail.” 

While  larger  programs  are  required  to 
submit  a  Cooperative  Opportunities 
Document,  this  generally  has  consisted 
of  “the  47  reasons  why  they  didn’t  be¬ 
come  cooperative.”  Because  of  ICRADs’ 
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poor  track  record,  the  Services  didn’t  want 
to  cooperate,  creating  a  self-fulfilling  proph¬ 
ecy.  Since  cooperative  programs  are  more 
difficult  and  complex,  they  have  a  lower 
probability  of  success.  Certainly  they  have 
more  players  with  the  resulting  exponential 
increase  in  communications  links.  Accord¬ 
ing  to  the  Law  of  Requisite  Variety,  the 
problem  and  (solution)  environments  need 
to  have  the  same  level  of  complexity.  Ad¬ 
ditional  resources  are  required  to  handle 
increased  ambiguity.  According  to  Jacobs 
and  Jacques  (1986),  an  integrative,  colle¬ 
gial,  nonlinear,  nonrational,  open  systems 
approach  is  required  under  conditions  of 
increasing  uncertainty.  Such  an  approach 
is  inherently  nonbureaucratic. 

CmiNG  Started 


As  with  any  analysis  of  alternatives, 
both  incentives  and  disincentives  must  be 
considered.  The  best  candidate  ICRADs 
propose  to  satisfy  Service  operational 
requirements  (commander-in-chief  needs) 


as  well  as  those  of  NATO  (used  here  to 
include  the  additional  five  nations — the 
seven  Nunn  nations  plus  Sweden — ^with 
whom  Congress  has  specifically  autho¬ 
rized  ICRADs).  Of  course,  multiservice 
requirements  can  add  a  broader  support 
base.  Technologies  in  which  our  allies  can 
make  more  significant  contributions 
through  extant  knowledge  or  mutual  use 
(such  as  mine  warfare,  interoperability,  or 
increased  competition  base)  are  highly 
advantageous  prospects.  Evolving  techno¬ 
logical  needs  such  as  coalition  OOTW  are 
also  prime  candidates. 

One  needs  to  “service  the  circuit”  for 
possibilities  and  opportunities  for  coop¬ 
eration.  Unfortunately,  the  Services  are  not 
organized  alike.  For  instance,  one  Service 
splits  up  authority  by  type  of  equipment, 
making  it  difficult  to  coordinate  with  other 
Services  or  nations  that  use  centralized 
systems.  The  Services  were  not  designed 
with  international  cooperation  in  mind.  Of 
course,  it’s  a  waste  of  time  to  start  a  pro¬ 
gram  with  no  compelling  U.S.  need 
(e.g,,  the  success  of  the  multifunctional 
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information  distribution  system  [MIDS] 
was  due  to  the  F/A-lS’s  need  for  it).  It 
should  be  in  the  POM,  or  potentially  so, 
in  its  own  right. 

ICRADs  save  scarce  U.S.  R&D  funds, 
but  they  also  take  longer.  In  essence,  the 
United  States  trades  time  for  allied  funds. 
The  program  in  question  must  be  able  to 
withstand  the  added  time  required.  Thus, 
the  present  International  Cooperative 
Opportunities  Group  (ICOG)  effort  is 
aimed  at  veiy  early  stages  of  development; 
“gleam  in  the  eye”  timing.  Unfortunately, 
in  an  era  of  declining  budgets,  this  limits 
opportunities  for  larger  (ACAT  [acquisi¬ 
tion  category]  I  or  II)  efforts.  “Adapting 

cooperation  to 
an  existing  pro¬ 
gram  is  doing  it 
backwards,”  and 
it  results  in 
disasters.  Also, 
the  timing  of 
the  project  must 
be  matched  for  the  nations  involved;  re¬ 
quired  fielding  dates  must  be  comparable. 
Joint  programs  have  similar  challenges. 

Time  can  be  saved  and  many  problems 
ameliorated  if  a  program  is  built  upon  prior 
efforts.  A  data  exchange  annex  (DBA),  an 
annex  on  a  particular  technical  area  to  a 
master  data  exchange  agreement  between 
the  United  States  and  another  nation, 
which  allows  for  the  international 
exchange  of  scientific  and  technical 
information  among  scientists  and 
engineers,  can  serve  as  a  springboard  to 
a  successful  ICRAD.  So  can  Engineer  and 
Scientist  Exchange  Program  experiences 
(Trimarran  is  one — a  Navy  ship  develop¬ 
ment  program)  (Kwatnoski,  1995). 
Indeed,  it  may  be  valuable  to  continue  a 
DEA  during  an  ICRAD  to  facilitate 


communications  and  data  sharing  (easier 
to  initiate  under  a  DEA  than  under  an 
MOU).  While  some  say  that  “the  best  ones 
bubble  up  in  a  lab,  while  the  weakest  ones 
are  top-down  directed,”  others  stress  the 
need  for  buy-in  from  both  the  requirements 
and  acquisition  communities, 

RimnoHS  With  Higher  AuiHORinis 

The  difficulties  of  introducing  major 
change  into  a  large  bureaucracy  are  legion: 
You  can’t  turn  an  aircraft  carrier  in  a  10- 
foot  circle.  A  change  agent  must  address 
the  psychological  turn  radius;  people 
operate  under  psychological  laws  rather 
than  the  laws  of  physics  (Pritchett,  1993). 
Thus,  a  purely  top-down  approach  rarely 
works — ^when  it  seems  to  work,  it  gener¬ 
ally  doesn’t  last  long  (only  till  the  driving 
force  leaves).  There  is  a  long  list  of  blue 
ribbon  panel  reports  and  DoD  initiatives 
one  can  review  at  leisure;  the  successful 
change  they  have  accomplished,  however, 
makes  for  a  quick  read  indeed. 

Some  evolutions  have  better  chances  for 
success.  The  recent  introduction  of  acqui¬ 
sition  reform  may  be  one,  particularly 
because  of  its  emphasis  on  customers  and 
stakeholders  and  its  practical  method  of 
integrated  product  teams  (IPTs).  Thus, 
acquisition  reform  can  be  instrumental  in 
resolving  differences  in  requirements  and 
perspectives,  such  as  harmonizing  joint 
requirements  for  the  advanced  concept 
technology  demonstration  project  to 
“translate”  messages  between  the  U.S. 
Army  and  U.S.  Marine  Corps  variable 
message  format,  and  the  U.S.  Air  Force 
and  U.S.  Navy  Link  16  data  transmission 
system.  The  four  Services  met  and  devised 
(with  some  difficulty)  an  initial  set  of 
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messages  to  be  so  “translated.”  Similar 
efforts  are  under  way  for  ICRADs  (e.g., 
ICOGs).  Of  course,  multinational  pro¬ 
grams  with  European  partners  have  his¬ 
torically  used  steering  committees  to  reach 
mutually  acceptable  agreements  address¬ 
ing  problems  and  opportunities.  The 
lesson  to  be  learned  is  that  stakeholders 
tend  to  buy  in  when  they  were  part  of  the 
decision  and  party  to  the  process. 

Correspondingly,  total  quality  manage¬ 
ment/leadership  (TQM/TQL)  has  failed, 
at  least  in  some  commands,  because  not 
all  levels  of  management  bought  into  it. 
In  a  particular  systems  command,  for 
instance,  the  commanding  officer  pushed 
it,  and  many  workers  bought  in  and  joined 
numerous  process  action  teams.  While 
some  improvements  were  implemented, 
TQL  never  entered  the  culture  because 
mid-level  management  never  accepted  it. 
Leaving  primary  stakeholders  out  of  the 
process  inhibits  its  effectiveness  and  lon¬ 
gevity.  The  ultimate  success  of  ICOGs  and 
ICRADs  depends  on  across-the-board 
acceptance  from  all  major  players  at  vari¬ 
ous  levels  within  DoD.  The  Quadrennial 
Defense  Review’s  creation  of  an  interna¬ 
tional  cooperative  task  force  or  the  creation 
of  the  Armaments  Cooperation  Steering 
Committee  will  not,  in  and  of  itself, 
accomplish  any  more  than  the  cooperative 
opportunities  documents. 

The  fact  that  Jacques  Gansler,  who 
chaired  the  Defense  Science  Board  study 
(1996),  has  become  Under  Secretary  of 
Defense  (Acquisition  and  Technology) 
(USD[A&T])  appears  to  be  a  good  sign 
for  both  acquisition  reform  and  coopera¬ 
tion.  As  Pritchett  (1993)  emphasizes,  top- 
level  support  is  essential  for  culture 
change.  This  includes  top-level  require¬ 
ments  people  as  well.  The  Joint  Chiefs  of 


Staff  (JCS),  the  commanders  in  chief,  and 
Service  requirements  personnel  establish 
the  out-year  needs  to  be  cooperatively  met. 
At  present,  JCS  support  seems  lukewarm 
and  the  commanders  in  chief  have 
evidently  not  been  players  at  all. 

Stating  a  need  for  cooperative  programs 
and  coalition  warfare  in  the  National  Mili¬ 
tary  Strategy  of  the  USA.  (Shalikashvili, 
1997)  md  Joint  Vision  2010  (Shalikashvili, 
1997)  is  not  comparable  to  active  support 
by  the  Atlantic  Commander  or  Supreme 
(NATO)  Commander,  Atlantic.  The  Atlan¬ 
tic  Commander  and  European  Command 
(a  U.S.  commander  in  chief),  with  vested 
interests  in  NATO  coalition  warfare,  are 
prime  candidates  for  support.  Larger  pro¬ 
grams  need  early,  high-level  endorsement. 
MIDS,  for  instance,  benefited  substan¬ 
tially  from  strong  USD(A&T)  support.  In 
addition,  as  the 
U.S.  national 
armaments 
director,  he  is 
positioned  to  in¬ 
fluence  high- 
level  Europeans 
to  open  doors, 

leading  to  fruitful  lower  level  contacts 
between  nations. 

But,  OSD/JCS  support  has  not  guaran¬ 
teed  success.  MEADS,  for  instance,  has 
barely  survived  despite  Congressional  and 
OSD  support.  A  truly  successful  program 
needs  a  solid  Service  requirement  to  be 
an  unqualified  success.  MIDS  has 
succeeded  (despite  the  U.S.  Air  Force 
pull-out  early  in  the  program)  only 
because  of  the  F/A~18’s  need  for  it.  With 
the  eventual  phaseout  of  the  F-14,  the  F/ 
A-18  will  be  a  carrier’s  only  fighter  and 
attack  aircraft.  Nothing  beats  a  real  need. 
Thus,  ICOGs  emphasize  primary  versus 
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marginal  requirements  for  new  ICRADs. 
Groups  such  as  the  Navy’s  Requirements 
and  Resources  Review  Board  (advising 
the  Chief  of  Naval  Operations  on  ROMs) 
should  be  tied  into  the  ICRAD  develop¬ 
ment  process. 

Of  course,  a  joint,  cooperative  program, 
while  more  complex,  provides  additional, 
potential  advocates  for  the  program  and 
identifies  parallel  requirements.  Should 
some  end,  the  program  may  still  survive 
(as  did  MIDS).  Such  programs  may  also 
receive  additional  OSD  support  and  fund¬ 
ing.  Since  the  DoD  infrastructure  “tends 
to  ignore  MOUs,”  it’s  important  to  “get 
the  Three  Stars  involved  in  the  process 
before  the  MOU  is  signed.”  Since  Service 
priorities  are  often  the  opposite  of  the 
DoDD  5000  priority  list,  cooperative 


benefits  to  the  Services  must  be  high¬ 
lighted  to  avoid  future  Service  funding  cuts. 
Milestone  Decision  Authority  (MDA)  sup¬ 
port  is  essential  for  any  program,  but  since 
MOUs  can  be  political  footballs  (with 
politics  overriding  business  sense).  Ser¬ 
vice  support  (both  requirements  and  ac¬ 
quisition)  is  quintessential  for  ICRADs. 
In  addition,  MDA-granted  waivers  should 
be  achieved  prior  to  signing  an  MOU. 

True  success,  however,  may  depend  on 
getting  policy,  requirements,  and  acquisi¬ 
tion  to  gel,  simultaneously  incentivized  for 
success.  Then  partnerships  of  “yes-sayers” 
can  check  the  usual  herds  of  naysayers. 
Figure  3  depicts  a  force-field  analysis  in 
which  to  prioritize  efforts  to  enlist  stake¬ 
holder  support,  considering  their  initial 
position  regarding  ICRADs  and  their 


Influence 


Figure  3.  Stakeholder  Force -Field  Analysis 
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influence  level.  The  “X”  with  the  arrow  is 
a  stakeholder  with  high  influence  and 
slightly  negative  valence — slightly  opposed 
to  a  cooperative  proposal — ^presenting  the 
best  cost-benefit  ratio  for  one’s  efforts  to 
gain  support  for  a  cooperative  approach. 

With  trust  always  a  major  issue,  per¬ 
sonal  contacts  are  important  and  effective, 
since  “familiarity  breeds  credibility.”  In¬ 
ternational  Overarching  IPTs  (OIPTs) 
must  be  extended  to  ICRADs  and  could 
include  appropriate  State  and  Commerce 
department  members.  It’s  better  than 
“going  to  war  with  the  State  Department.” 

DEfiNiTiON  OF  Requirements 


A  cooperative  requirements  phase  is 
absolutely  necessary  before  beginning 
development  or  signing  an  MOU.  In  ad¬ 
dition,  a  solid  Service(s)  mission  need 
should  be  well  established  before  negoti¬ 
ating  cooperative  requirements.  A  signed 
operational  requirements  document 
(ORD)  (with  Joint  Requirements  and 
Oversight  Council  and  Joint  Requirements 
Board  support)  and  threat  assessment  are 
highly  recommended  as  well.  A  NATO 
staff  requirement  or  Military  Operational 
Requirement  can  also  be  quite  valuable. 
Optimally,  the  program  can  be  linked  to 
commander-in-chief  regional  strategies. 
Joint  Vision  2010  (Shalikashvili,  1997), 
the  National  Military  Strategy  of  the 
U,SA,  (Shalikashvili,  1997),  the  DoD 
international  strategic  plan,  and  especially. 
Systems  Command  and  program  execu¬ 
tive  office  business  plans  and  budgets. 
More  specifically,  the  planning  horizon 
must  be  appropriate,  allowing  enough 
time  for  MOU  negotiations  as  well  as 
international  program  development. 


Prospective  participants  must  have  a 
common  need,  not  only  of  technical 
specifications,  but  also  of  need  dates,  and 
acceptable  system  maturity  and  risk. 
While  interfaces  and  protocols  are  prior¬ 
ity  issues,  platform  integration  should  be 
excluded  from  common  efforts.  The  goal 
is  a  set  of  mutually  acceptable,  fiilly  har¬ 
monized  and  rationalized,  functional 
performance  specifications  versus  a  target 
equipment  design. 

As  much  acquisition  reform  as  possible 
should  be  incorporated  (e.g.,  commercial 
specifications  or  NATO  standardization 
agreements  versus  mil-specs  or  stan¬ 
dards).  While  commercialization  is  new 
to  some  countries,  most  are  familiar  with 
ISO  9000/1,  a  usable  base-line  for  the 
introduction  of  commercial  parts  and 
specifications. 

Successful  harmonization  depends  on 
securing  a  proactive  advocate  for  coop¬ 
eration  and  sensitivity  to  foreign  partners’ 
perspectives  and  concerns. 

•  “Don’t  try  to  force  things  down 
NATO’s  throat.”  It  is  wise  to  use  writ¬ 
ten  definitions,  consistent  terminology, 
and  sensitivity  analyses  to  refine 
requirements  and  avoid  gold  plating. 

•  “Clarity,  stability,  and  mutual  under¬ 
standing  of  project  requirements  were 
considered  to  be  of  paramount  impor¬ 
tance”  (Kwatnoski,  1995).  Explain  and 
persuade;  “I  need  it”  doesn’t  work. 

•  “The  perception  of  the  threat  varies 
from  nation  to  nation”  (Defense 
Science  Board,  1996).  While  the 
United  States  targets  the  entire  world 
environment  including  extreme 
climates  (Farr,  1985),  Europeans  have 
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narrower  environmental  requirements. 
Furthermore,  the  United  States  tends 
to  undertake  riskier  programs,  and  part¬ 
ners  often  differ  greatly  in  technical 
capacity. 

•  Don’t  try  “too  hard  to  look  for  one  so¬ 
lution  to  satisfy  all  requirements” 
(Business  Week,  1997).  “[Since]  you 
can’t  give  orders  to  other  countries, 
avoid  a  dictatorial  approach,  get  con¬ 
sensus.”  Be  aware  of  nationalism, 
sovereignty  issues,  and  personal  pride. 

The  fight  for  commonality  is  a  long 
process.  While  “there’s  a  lot  of  advantages 
in  being  the  biggest  and  the  best,”  a  flex¬ 
ible  approach  is  likely  to  have  the  most 

success,  espe¬ 
cially  consider¬ 
ing  differences 
in  language, 
perspectives, 
and  terminol¬ 
ogy.  Keep  the 
team  focused 
on  identifying 
similarities  and  differences;  avoid  getting 
sidetracked  by  support  functions  and 
specialist  views.  Only  a  generalist 
approach  is  appropriate  for  trading  off 
amongst  specialty  desires  or  needs. 

Since  costs  must  be  evaluated  against 
requirements,  prioritization  is  essential. 
Operating  and  acquisition  community 
views  must  both  be  considered  in  order  to 
achieve  a  program  that  adequately 
satisfies  common  needs  but  is  also  a 
“doable  do”  as  far  as  implementation. 
Understanding  the  cost  impact  of  specific 
requirements  often  greatly  facilitates  reso¬ 
lution  of  differences.  Goals  versus  thresh¬ 
olds  can  be  useful,  especially  considering 


that  eventually  the  acquisition  program 
baseline  will  contain  these  as  well  as  cost 
as  an  independent  variable,  schedule,  tech¬ 
nical,  and  other  requirements.  When 
examining  the  issues  to  determine  the  hard 
spots,  look  for  unknown  disagreements 
(“what  we  don’t  know  that  we  don’t 
know,”  a  la  the  Johari  Window  [Mink, 
Schultz,  and  Mink,  1979])  as  well  as 
“conflicts  of  agreement”  (Harvey,  1988). 
It’s  better  to  identify  problems  early  (“pay 
me  now  or  pay  me  later”). 

It’s  easier  to  do  one  issue  at  a  time. 
Historically,  many  problems  arise  because 
of  a  lack  of  understanding.  Simplify  the 
problem  in  a  “horsy-ducky  way” — ^when 
you  see  it,  you  understand  it.  Perceptions 
are  important;  they  define  reality.  Don’t 
confuse  nonrational  approaches  with 
irrational  ones.  Different  nations  have 
different  Myers-Briggs  personality  type 
indicator  preferences  (Pollock,  1995),  and 
approach  problems  and  solutions  differ¬ 
ently.  It  helps  to  sincerely  try  to  understand 
why  a  nation  wants  a  particular  require¬ 
ment.  “Ninety  percent  of  problems  vanished 
once  they  were  understood;  get  outside 
experts  for  the  other  10  percent.”  Mitre, 
for  instance,  was  quite  helpful  in  resolv¬ 
ing  problems,  and  some  other  countries 
also  have  federally  funded  R&D  centers. 

Some  of  the  overall  cost  savings  of 
cooperative  programs  go  toward  delivery 
of  certain  requirements  that  particular 
nations  don’t  need.  The  prime  rule  of 
systems  engineering  is:  “Optimizing  the 
whole  de-optimizes  the  parts;  optimizing 
the  parts  de-optimizes  the  whole.”  Work 
to  optimize  the  whole. 

Enthusiastic  discussions  and  brain¬ 
storming  are  ideal,  but  avoid  heated  argu¬ 
ments.  One  may  have  to  resort  to  higher 
level  leadership  to  get  unstuck.  Project 
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definition  and  the  validation  phase  cannot 
be  completed  until  the  draft  is  endorsed 
at  home;  one  may  be  forced  to  back  off 
on  an  issue  when  it’s  staffed.  Also,  a  solid, 
projected  cost  and  schedule  will  be  needed 
before  participants  can  commit  to  the 
project.  Be  prepared  to  introduce  wedges 
into  the  POM  as  soon  as  practicable.  If 
possible,  investigate  the  existence  of  pos¬ 
sible  competing  programs  or  engineering 
changes,  especially  “black”  ones:  These 
have  eliminated  several  promising  coop¬ 
erative  efforts  (e.g.,  the  Multiple-Launch 
Rocket  System  (MLRS)  terminally  guided 
warhead)  in  the  past.  Avoid  late  joiners 
who  can  and  will  destroy  prior  harmoni¬ 
zation  agreements,  and  “be  willing  to  be 
fired  a  few  times!” 

ReutionsWiinIoreign 

PiRSONHEl  RHP  GOVERIIMEHTS _ 

“Everybody  sees  the  elephant  differ¬ 
ently.”  Understanding  another  culture  is 
extraordinarily  useful  when  working  on 
international  programs.  “A  nod  may  mean 
T  hear  you,’  not  1  agree  with  you’  (SAM 


II  History,  1996).  Some  cultures  put  the 
bad  news  first,  some  last.  Extroverts  tend 
to  think  out  loud,  introverts  do  not.  There 
are  large  cultural  differences  between  us 
and  even  our  closest  NATO  allies.  For 
instance,  an  informal  study  indicated  ste¬ 
reotypical  norms  for  the  United  States 
(ESTJ),  Germany  (ISTJ),  and  France 
(INFP).  (Pollock,  1995) 

For  those  readers  not  familiar  with  the 
Myers-Briggs  Type  Indicator™,  com¬ 
monly  referred  to  as  MBTI^m,  this  per¬ 
sonality  profile  captures  preferences  of 
individuals  for  how  they  focus  their 
attention,  the  ways  they  like  to  receive 
information  and  make  their  decisions,  and 
the  lifestyles  they  adopt.  Many  groups  of 
individuals  in  a  profession,  such  as  engi¬ 
neers,  share  the  same  code  letters  and 
traits.  Some  large  groups  like  countries 
even  share  similar  traits.  The  terminology 
is  as  follows:  I  =  Introvert;  E  =  Extrovert; 
S  ==  Sensing;  N  =  iNtuitive;  T  =  Thinking; 
F  =  Feeling;  J  =  Judging;  P  =  Perceptive 
(Briggs-Myers  &  McCaulley,  1985). 

Sensitivity  to  and  respect  for  such 
cultural  differences  can  greatly  facilitate 
communications  and  problem  solving. 


Official  DoD  photo. 


The 

Multiple- 

Launch 

Rocket 

System 

(MLRS) 


227 


AtquisHion  Iteyiew 


Indeed,  at  higher  levels  of  complexity  and 
ambiguity,  a  collegial  atmosphere  works 
best  (Jacobs  and  Jacques,  1986),  because 
it  minimizes  the  impact  of  cultural  differ¬ 
ences.  These  differences  may  influence 
something  as  basic  as  a  meeting  agenda: 

For  example, 
«  Europeans  may 

ireoiivviviivciKt' 

*.5Se.— M..  ™P”'; 

■WI>M,  IW  “ 

'“St  or  revisit 

iiHiMWWfy.  them  at  the  end 

fiiHi  of  a  meeting. 

Some  Ameri- 
cans  view  this 
as  a  negotiation 
tactic.  It  is  ex¬ 
tremely  dangerous  to  project  intentions 
onto  a  person  from  a  different  culture.  All 
too  often,  we  rationalize  and  fail  to  analyze 
our  own  intentions.  As  Farr  states  (1985), 
“there  are  too  few  internationalists  who 


can  think  with  the  other  guy’s  hat  on.” 

Management  styles  are  almost  antitheti¬ 
cal  between  Americans  and  Europeans. 
The  Europeans  generally  commit  funding 
for  the  life  of  the  program,  do  not  need 
to  continually  defend  it,  demonstrate 
patience,  and  use  a  macro-management 
approach.  The  United  States  generally 
commits  funds  annually  (and  doesn’t 
necessarily  support  the  profile  for  even 
a  year),  constantly  has  to  defend  the 
program  to  numerous  decision  authorities 
(management,  financial,  contractual,  etc.), 
constantly  revisits  all  program  param¬ 
eters  (cost,  schedule,  performance,  and 
operability),  and  micro-manages. 

Administrative  differences  also  abound, 
from  U.S.  reliance  on  e-mail  (and  the  push 
for  the  paperless  office)  to  the  use  of 
81/2x11”  paper.  Not  all  allies  have  e-mail, 
and  many  use  A4  paper.  The  latter 


considerably  complicates  faxes.  Faxes  are 
heavily  used,  especially  due  to  time  zone 
differences.  When  the  MIDS  program 
office  was  moved  as  a  result  of  the  Base 
Realignment  And  Closure  (BRAC)  Act  to 
San  Diego,  the  Europeans  faced  a  9-hour 
time  difference  for  phone  calls  with  Inter¬ 
national  Program  Office  (IPO)  personnel. 
This  greatly  limited  the  daily  amount  of 
phone  time  available. 

Despite  the  many  differences,  our  allies 
are,  first  and  foremost,  people.  Thus,  it  is 
best  to  build  on  shared  motivations  and 
demonstrate  commitment  to  high  ethical 
standards  (honoring  commitments  and 
avoiding  end  runs).  Be  prepared  for  items 
to  move  slowly,  if  only  because  of  the 
number  of  communications  links  (which 
increase  exponentially  with  the  number 
of  participants).  Parallel  processing 
often  helps,  once  a  reasonable  level  of 
trust  has  been  established.  Allies  do  not 
understand  the  U.S.  acquisition  system 
(a  moving  target  even  to  experienced 
acquisition  professionals),  just  as  we  do 
not  understand  theirs.  Be  prepared  to 
educate  newcomers  as  required. 

Negotiators,  steering  committee  mem¬ 
bers,  IPO  representatives,  managers, 
executives,  and  politicians  are  constantly 
changing.  Their  military  members  “rotate” 
just  as  ours  do.  The  cadre  of  players  is 
continually  evolving  no  matter  what  stage 
a  program  is  in.  New  players  carry  their 
personal  as  well  as  cultural  backgrounds, 
experience  base,  values,  assumptions, 
sense  of  time,  and  procedures  with  them. 
To  bridge  differences,  it  is  often  helpful 
to  identify  items  that  affect  others  simi¬ 
larly,  such  as  the  globalization  of  industry, 
declining  military  budgets,  and  OOTW. 

When  there  are  definite  differences  in 
acquisition  policy  or  culture,  it  helps  to 
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explain  what  the  effect  is  upon  you  as  well 
as  upon  them.  For  instance,  U.S.  acquisi¬ 
tion  reform  and  BRAC  can  be  understood 
better  when  the  U.S.  representative  points 
out  how  the  changes  have  affected  or  are 
expected  to  affect  him  or  her — ^not  just 
how  the  NATO  listener  will  be  affected. 
Assuming  someone  will  see  the  light  may 
leave  you  in  the  dark. 


discussions),  and  “the  automatic  percep¬ 
tion  by  some  that  U.S.  technology  is  way 
ahead  of  Europe.”  It’s  difficult  to  cooper¬ 
ate  when  the  United  States  “wants  to  stay 
ahead  of  everyone  else.”  Such  attitudes  can 
extrapolate  into  a  “we  develop,  you  buy 
mentality”  hardly  conducive  to  coopera¬ 
tive  development  or  even  to  coalition 
warfare  (F;irr,  1985). 


Typicai  American  View 
or  Cooperative  Auies 

“We  have  more  in  common  with  fel¬ 
low  Services  in  Europe  than  with  other 
U.S.  Services!”  This  can  make  a  bilateral, 
same-Service  ICRAD  very  palatable.  The 
U.S.  Navy,  for  instance,  has  numerous 
bilaterals  (e.g.,  Trimarran,  cooperative 
outboard  logistics  upgrade,  and  surface 
ship  torpedo  defense)  with  the  British 
Admiralty. 

On  the  other  hand,  there  is  much  chaf¬ 
ing  in  these  overseas  relationships.  The 
British  are  known  as  hard  bargainers. 
Complaints  range  from  the  $6  price  of  a 
beer  in  Norway  to  European  block  voting. 
Sometimes  European  behavior  is  viewed 
as  offensive  (but  American  behavior  is  as 
well).  Europeans  do  not  understand  the 
United  States’  need  for  flexible  schedules 
and  costs  or  the  need  for  competition 
(Europe  is  truly  the  home  of  the  military- 
industrial  complex,  where  sole  source  is 
a  way  of  life).  It  is  difficult  to  create  a 
competitive  transatlantic  consortium  when 
each  partner  names  the  source  for  its 
country’s  work  share.  Only  the  U.S. 
portion  of  the  contract  is  then  competed. 
Other  barriers  to  cooperation  include 
security  restrictions  on  communications 
with  allies  (originating  from  the  Defense 
Intelligence  Agency  or  the  National 
Security  Agency,  as  appropriate,  prior  to 


TVpicai  Auied  View 
OP  Cooperative  Americans 

To  potential  cooperative  partners, 
“having  the  United  States  is  a  great  prize 
but  difficult  to  work  with;  rigid.”  Many  of 
the  complaints  concern  the  U.S.  political 
system:  “The  United  States  has  the  Buy 
America  Act;  there  is  no  Buy  British  Act.” 
“The  United  States  is  reluctant  to  depend 
on  allies,  but  wants  allies  to  depend  on 
the  United  States.”  Further,  the  United 
States  imposes  extra-territoriality  (e.g.,  no 
allied  trade  with  Cuba  and  restricted  sales 
of  high  technol¬ 
ogy  to  South 
America)  to  the 
detriment  of  al¬ 
lies.  Also  re¬ 
sented  is  U.S. 
arrogance  about 
being  the  best, 
and  its  bad  case 
of  the  not-in- 
vented-here 

syndrome.  Thus,  the  United  States  is 
viewed  as  protectionist  (two  items  that 
often  arise  are  certain  types  of  ball 
bearings  and  textiles). 

It  might  help  if  the  United  States 
opened  the  North  American  Free  Trade  Act 
to  Europe.  The  Western  European  Union 
may  act  to  counter  U.S.  protectionism. 
Europeans  “want  to  avoid  a  one-way 
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superhighway  of  sales  to  Europe  versus 
true  partnership”  (Farr,  1985)  and  avoid 
“a  country  lane  going  west  and  a  super¬ 
highway  going  east”  (Abbott,  1997).  The 
Defense  Security  Cooperation  Agency 
(DSCA)  is  seen  as  promoting  U.S.  exports 
via  foreign  military  sales,  which  is  viewed 
“like  Japan  dumping  cars  in  the  United 
States.”  This  parallels  a  perceived  attitude 
that  “if  it’s  good  for  the  United  States,  it’s 
good  for  NATO.”  The  United  States  needs 
better  credibility  as  an  honest  broker. 
Rather  than  trying  to  force  something 
down  NATO’s  throat,  the  United  States 
could  seek  to  understand  NATO  goals. 

Loyalty  to  one’s  country  is  often 
viewed  as  “nonparochial.”  Work  share  and 
offsets  are  viewed  as  strengthening  a 
nation’s  industry  and  economic  base, 

which  are  es¬ 
sential  for  a 
strong  military. 
French  rivalry 
with  the  United 
States  is  based 
upon  similar 
ambitions;  she 
sees  herself  in 
direct  competi¬ 
tion  with  the 
United  States  as 
the  European 
defense  technology  leader. 

But  much  of  the  difficulty  concerns 
differences  exacerbated  by  the  lack  of 
international  experience  of  U.S.  person¬ 
nel.  Indeed,  the  United  States,  it  is  said, 
“has  a  teenager  viewpoint.”  The  United 
States  wants  total  defense  capability  across 
the  spectrum,  wants  the  allies  to  help  pay 
for  it,  and  wants  continual  upgrades  (e.g., 
the  F-16) — ^forcing  allies  to  spend  more 
or  become  incompatible.  “It’s  inefficient 


AMilmgi  wMi  eMme, 


iiwnl^wsiqimlor 


for  the  United  States  to  seek  dominance 
in  everything.” 

Furthermore,  the  U.S.  acquisition 
system  gets  its  share  of  complaints.  “The 
U.S.  system  is  full  of  lawyers”  (and  has  a 
regulatory  mindset);  requests  for  proposal 
(RFPs)  allow  only  60-90  days  for  con¬ 
tractors  to  respond,  but  it  takes  the  U.S. 
State  Department  60  days  to  release  the 
RFP  to  allied  bidders;  the  United  States 
presents  a  veto  problem  for  third  party 
sales;  and  cooperative  efforts  get 
“ambushed  by  the  many,”  a  reference  to 
the  large  number  of  players  in  the  U.S. 
approval  process  (Kwatnoski,  1995). 

To  offset  these  perceptions  when  deal¬ 
ing  with  allies,  the  United  States  must 
exhibit  a  cooperative  attitude  instead  of  a 
nationalistic,  self-important,  or  superior 
one.  The  United  States’  widely  broadcast 
exuberance  over  becoming  “the  only 
superpower”  reminds  one  of  the  fans  at  a 
ball  game  chanting  “We’re  number  one!” 
When  the  United  States  unilaterally 
cancels  cooperative  programs,  replacing 
them  with  national  ones  (e.g.,  brilliant 
anti-armor  submunition),  France  needs  no 
excuse  to  leave  MEADS  and  pursue  its 
own  national  program.  It’s  little  wonder 
that  Kwatnoski’s  survey  (1995)  found 
allies  stressing  trust  and  commitment,  but 
Americans  not  (similar  to  Farr’s  findings 
[1985]  on  European  versus  American 
commitment).  Nevertheless,  recent  mili¬ 
tary  down-sizing,  industrial  consolidation, 
and  other  trends  provide  an  opportunity 
to  increase  understanding,  cooperation, 
and  competition.  For  instance,  it  was  noted 
that  “the  Atlantic  is  narrower  than  the 
English  Channel  in  some  respects,”  and 
that  “it  serves  no  purpose  to  protect 
companies  that  are  basically  noncompeti¬ 
tive”  (American  Defense  Preparedness 
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Association,  1997).  But  international  com¬ 
petition  must  also  be  open  and  reciprocal 
to  be  politically  defensible. 

Memorandum  OF 

Uhperstahdimg  Peveiopmeht _ 

An  MOU,  from  first  draft  to  final  sig¬ 
nature,  can  take  anywhere  from  2  months 
(minimum  according  to  the  NIPO)  to  26 
years  (maximum  according  to  the  Defense 
Systems  Management  College).  A  reason¬ 
able  planning  estimate  is  probably  about 
2  years,  though  there  are  new  procedures 
to  accelerate  this  process.  Prior  execution 
of  a  DBA  amongst  the  partner  nations  can 
greatly  facilitate  this  process.  Before  begin¬ 
ning,  the  requirement  should  have  been 
defined  and  harmonized,  the  participating 
nations’  representatives  identified,  and  the 
type  of  agreement  determined.  These  rep¬ 
resentatives  (principals)  either  will  form 
or  represent  a  steering  committee  (SC). 

Generally,  technical  discussions  take 
place  prior  to  formal  negotiations.  These 
discussions  cannot  decide  anything  and 
cannot  draft  MOU  language,  since  these 
responsibilities  are  reserved  for  designated 
negotiators  (such  as  those  in  the  NIPO). 
However,  principles  of  cooperation  (POC) 
are  defined  during  technical  discussions, 
which  are  the  basic  approaches  underly¬ 
ing  the  resulting  MOU.  While  not  bind¬ 
ing  on  the  negotiators,  they  serve  as  guide¬ 
lines  for  negotiation.  They  should  have  a 
consistent  thrust,  forming  a  “thread 
through  the  document  more  important 
than  the  exact  words  of  the  text.”  Usually 
the  POC  are  written  in  the  form  of  a  list, 
worded  in  a  nonbinding  manner:  “The 
participants  intend  (or  seek)  to....”  They 


are  often  drafted  by  program  personnel. 

The  basic  structure  must  also  be  chosen. 
Many  MOUs  are  written  as  stand-alone 
documents  addressing  an  individual 
program  phase  (e.g.,  engineering  and 
manufacturing  development),  although 
paragraphs  from  prior  phase  MOUs  may 
be  incorporated  by  reference.  There  are, 
however,  alter¬ 
natives.  Pro- 

gram  MOUs  mOO*  mm 

(PMOUs)pro-  ”7“**".***-*”^“ 

vide  a  standard  ,  ,  * 

.  ,  .  «i4dr«ssiii«  HU 

framework  for 

the  lire  or  the  pliffinf  jp, 
program  with  •ttglnem-liif  ami 
supplements  maiwfodvring 

specific  to  each 
program  phase. 

The  initial  sup¬ 
plement  is  negotiated  with  the  PMOU. 
Thereafter,  only  phase-specific  issues  need 
be  negotiated  for  later  supplements  or 
phases.  More  recently,  technical  R&D 
projects  have  been  instituted  with  country 
umbrella  agreements  and  project  annexes. 
These  annexes  can  take  half  the  time  of  a 


regular  MOU,  and  their  small,  early  R&D 
projects  can  be  delegated  to  the  SC  for 
signature. 

MOUs  for  larger  programs  may  be 
signed  by  the  national  armaments  direc¬ 
tor  of  each  nation:  In  the  United  States, 
this  is  the  USD(A&T),  but  signature 
authority  can  be  delegated  to  service 
acquisition  executives  for  smaller  pro¬ 
grams.  The  DoD  international  agreements 
generator  (lAG)  software  program  (devel¬ 
oped  by  the  NIPO)  is  available  to  MOU 
authors.  The  executive  secretary  of  the  SC 
may  compose  the  first  draft  using  the  lAG 
and  POC.  The  NATO  Group  on  Acquisi¬ 
tion  Practices  (AC313)  has  promulgated 
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“Guidelines  and  Sample  Provisions  for 
Memoranda  of  Understanding,”  contain¬ 
ing  language  similar  to  the  I  AG.  The  lAG 
contains  actual  paragraph  wording  for 

MOUs  with  nu¬ 
merous  altema- 
mrm  tives  included. 

ImiMiMiMililM  The  Defense 

Sys.e™,M.,.. 

flieiMit*'"  agement  Col¬ 

lege  program 
: ;  manager  T304 
course  (Advanced  International  Manage¬ 
ment  Workshop  or  AIMW)  trains  person¬ 
nel  to  write  and  negotiate  MOUs;  it  is 
highly  recommended.  Service  experts 
(such  as  NIPO)  can  provide  prior  MOUs 
and  information  on  the  latest  options  (e.g., 
the  joint  strike  fighter’s  core  master 
agreement  approach).  While  prior  MOUs 
can  be  quite  helpful,  they  have  already 
been  negotiated  and,  therefore,  are  not  well 
constituted  as  going-in  or  opening 
positions,  since  they  are  already  reflective 
of  compromise. 

Prior  to  negotiations  for  the  initial  draft 
MOU  (for  an  R&D  project),  a  summary 
statement  of  intent  (SSOI)  must  be  for¬ 
mulated,  submitted,  and  approved.  The 
SSOI  generates,  hopefully,  authority  to 
negotiate  that  is  formally  approved  and 
forwarded  to  the  U.S.  principal.  Service 
specialists  run  interference  for  the  approval 
process,  but  one  must  communicate  the 
nature  of  the  project  to  them  so  that  the 
right  people  are  assigned  to  the  project. 
They  also  lead  or  staff  the  negotiations 
delegation  (including  legal  experts),  along 
with  the  principal’s  technical  representa¬ 
tives.  Thus,  it  is  necessary  to  explain  the 
unique  nature  of  the  project  to  the  MOU 
specialists,  for  which  a  mutually  support¬ 
ive  and  well-coordinated  IPT  is  ideal. 


Vision,  goals,  and  objectives  can  then  be 
shared  and  refined.  The  United  States’ 
going-in  position  and  ranges  of  acceptable 
outcomes  can  then  be  devised.  “Lawyers 
are  important  but  the  program  manager 
must  lead  and  set  the  tone.”  “Lawyers  want 
rigid  structure,  but  you  need  flexibility  to 
adapt  to  changes;  funding  per  year  can’t 
be  fixed.”  But  “One  word  crafted  by  a  law¬ 
yer  is  worth  a  thousand  pictures.”  In  any 
case,  MOU  experts  serve  as  “your  ency¬ 
clopedia.”  It  might  also  be  helpful  to 
peruse  the  DUSD(I&CP)  International 
Armaments  Cooperation  Handbook 
(1996)  for  a  process  overview. 

IHOII  CONTIMT _ _ 

Regarding  the  initial  draft,  a  balance 
must  be  struck  between  a  strong  opening 
position  and  what  can  fly.  An  unrealistic 
starting  point  not  only  slows  down 
negotiations,  but  detracts  from  credibility 
and  a  perception  of  equability  (a  U.S.  statu¬ 
tory  requirement).  Use  consistent  termin¬ 
ology  and  provide  written  definitions,  and 
try  to  avoid  multilingual  documents — 
language  certification  can  cause  delays 
and  misunderstandings.  Create  a  Rich 
Text  Format  file  as  well  as  a  word  proces¬ 
sor  file  and  maintain  them  on  diskettes, 
use  the  “Keep  it  simple,  stupid”  (KISS) 
principle,  and  “wallow  in  the  document.” 
Obtain  an  OSD  cheerleader  who  can 
facilitate  the  entire  process  and  be  a  pro¬ 
gram  advocate — especially  if  the  program 
is  or  may  become  joint.  According  to  a 
number  of  those  interviewed,  the  big  five 
challenges  are:  management  structure, 
finance  (including  cost  share),  contract¬ 
ing  (including  work  share),  information 
disclosure  (and  use),  and  third  party  sales 


232 


Infemational  Cooperative  Reseanh  anti  Development  Programs 


and  transfers.  But  any  area  can  present 
problems  with  a  particular  nation.  Most 
important,  extrapolate  results  of  any  agree¬ 
ment:  “Those  who  write  the  MOU  don’t 
have  to  execute  it.”  Use  authority  respon¬ 
sibly.  Use  the  Porridge  Principle:  neither 
too  hot  nor  too  cold  (not  too  vague,  not 
too  detailed). 

Depending  upon  the  size  of  the  program 
and  the  particular  nations  (and  number) 
involved,  an  SC  will  oversee  the  program 
(a  principal  and  deputy  per  nation),  sup¬ 
ported  by  an  IPO.  Usually,  the  United 
States  serves  as  host  nation  (providing 
nonreimbursed  support,  the  SC  chair, 
program  manager,  and  executive  secre¬ 
tary),  with  the  IPO  (including  international 
representatives)  located  in  the  United 
States.  This  is  optimal  for  efficiency  if  the 
overhead  is  affordable.  Avoid  overly  pre¬ 
defining  positions  to  be  occupied  later  by 
internationals  (other  than  the  deputy  pro¬ 
gram  manager),  since  they  will  probably 
be  unfamiliar  with  the  U.S.  acquisition 
system. 

In  most  programs,  each  nation  gets  one 
vote  and  all  votes  must  be  unanimous.  This 
provides  veto  power,  which  can  be  highly 
detrimental  in  certain  cases,  especially  if 
used  as  a  threat.  In  some  cases  (e.g..  Sea 
Gnat),  however,  voting  situations  have 
been  divided  into  classes  with  some  criti¬ 
cal  areas  retaining  the  veto  and  others 
being  decided  proportionally  (e.g.,  by  cost 
share).  Since  the  United  States  often  pro¬ 
vides  a  disproportionate  share  of  the  funds 
(more  than  40  percent  for  some  large 
projects),  this  is  highly  desirable. 

Configuration  management  (including 
software  maintenance)  is  also  an  impor¬ 
tant  issue  since  interoperability  is  a  major 
ICRAD  advantage.  Authority  can  be 
vested  in  the  IPO  and  SC  as  appropriate. 


The  program  manager  must  have  veto 
power  over  IPO  appointments  (though  it 
must  be  used  sparingly)  and  sufficient 
authority — don’t  strangle  the  program 
manager!  Provide  as  much  authority  to  the 
SC  as  possible.  Often  agreements  can  be 
relegated  to  subsidiary  documents  (such 
as  the  program  management  plan)  con¬ 
trolled  by  the  SC.  Also,  acceptable  ranges 
can  be  preset,  with  the  SC  empowered  to 
approve  targets  within  the  accepted  range 
(similar  to  U.S.  acquisition  program 
baseline  goals  versus  thresholds).  It  is  very 
important  to  avoid  later  problems  by 
defining  program  officials’  responsibilities 
beforehand. 

Payment  in  U.S.  funds  is  important.  The 
MIDS,  for  in- 
Stance,  had  the 
nightmare  ofi 
five  currencies 
with  bank  ac- 
counts  in  each 

currency  in  each  ttileii  itomsKfertviil*" 

nation.  The  five 

subcontractors  were  paid  in  their  own 
country’s  currency.  There  was  a  consider¬ 
able  price  paid  in  terms  of  time  delays, 
personnel,  and  overhead. 

Exchange  and  inflation  rates  also 
become  challenges.  Equitable  cost  shar¬ 
ing  is  subject  to  considerable  interpreta¬ 
tion.  Europeans  often  wish  to  match  each 
nation’s  projected  off-take  (number  of 
equipment  units  to  be  delivered)  percent¬ 
age  to  their  cost  contribution.  But  many 
operating  costs  are  not  dependent  on  the 
number  of  units,  and  the  host  nation  alone 
pays  for  many  items.  Some  programs  have 
devised  a  two-tier  approach:  Some  cost 
items  are  shared  equally  and  some  are  by 
off-take  percentage.  Of  course,  the  MOU 
must  define  items  by  category. 
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In  addition,  a  national  versus  common 
or  shared  cost  category  is  necessary  for 
items  not  desired  by  all  participants. 
Engineering  changes  are  a  special  case; 
some  MOUs  provide  that  only  those 
nations  requesting  the  change  pay  for  the 
nonrecurring  costs,  but  all  nations  pay  the 
recurring  costs.  These  approaches  are 
theoretically  satisfying,  but  caution  is 
advised  since  not  all  nations  are  necessar¬ 
ily  forthcoming  or  acciu^ite  regarding  their 
projected  off-take  or  desire  for  a  specific 
engineering  change. 

Contracting  is  presently  in  a  state  of 
flux.  U.S.  acquisition  reform  efforts 

include  new 
contractual 
agreements, 
such  as  use  of 
commercial 
products  and 
specifications, 
dual-use  manu¬ 
facturing,  the 
single  process 
initiative,  and 
electronic  data 
interchange. 
Not  all  potential  partners,  however,  are  fa¬ 
miliar  with,  or  capable  of  handling  all  of 
these  innovations.  Be  prepared  to  explain 
and  defend  them.  Foreign  industries  are 
often  not  independent  of  governments, 
and  true  competition  is  often  nonexistent. 
International  consortia  are  probably 
unavoidable,  with  most  nations  specifying 
their  participating  company. 

Also,  work  share  will  indubitably  be 
equal  to  cost  share.  However,  it  is  highly 
recommended  that  error  factors  be  used — 
that  is,  each  share  should  have  a  range  of 
acceptable  values  or  an  accepted  percent 
of  deviation  (e.g.,  20  percent).  Also,  while 


the  SC  will  review  the  actual  figures 
against  targets,  the  prime  contractor 
should  allocate  the  work  under  the  given 
guidelines.  An  award  or  incentive  fee  can 
be  invoked  to  motivate  compliance.  If  pos¬ 
sible,  have  the  prime  contractor  or 
integrator  excluded  from  work  share. 

Assignment  of  specific  assemblies  or 
software  can  be  a  problem,  since  compa¬ 
nies  vary  in  abilities.  Often,  firms  with  less 
experience  in  an  area  will  lobby  to  per¬ 
form  that  task  (as  a  technology  transfer 
benefit;  one  of  the  main  reasons  foreign 
nations  collaborate),  which  can  add  enor¬ 
mous  technical,  schedule,  and  cost  risk. 
Be  prepared  to  fight  to  have  work  share 
distributed  on  the  basis  of  capability. 
“Work  share  is  more  art  than  science;  get 
companies  to  work  on  it.”  A  government- 
industry  team  may  help. 

The  roles  of  the  SC  and  IPO  in  con¬ 
tractor  selection  must  be  predefined.  IPO 
reviewers  will  need  the  education 
necessary  to  fairly  evaluate  bidders  in 
accordance  with  host  nation  laws  and  regu¬ 
lations.  The  SC  should  review  IPO  find¬ 
ings  and  recommendations,  but  should  not 
have  selection  authority.  The  SC  chair  (the 
program  executive  officer)  may  be  the 
selection  authority,  but  the  final  decision 
may  require  higher-level  (Milestone 
Decision  Authority)  review  and  approval. 
However,  in  some  cases  the  participants 
choose  to  use  NATO  contracting  rules  or 
a  NATO  management  agency,  which 
greatly  complicates  matters. 

“Foreign  disclosure  policy  can  be  the 
long  pole  in  the  tent.”  Partners  are  just  as 
interested  in  information  as  in  hardware 
and  software.  Background  information 
produced  by  a  nation  outside  the  program 
(usually  prior  to)  can  be  used,  if  provided 
to  principals  or  contractors,  but  not 
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released  outside  the  program.  This  must 
be  delineated  in  the  MOU. 

Foreground  information  (produced  by 
the  program)  can  generally  be  used  by  par¬ 
ticipants  outside  the  program,  but  specific 
allowable  uses  can  be  specified.  Govern¬ 
ment  use  property  rights  are  becoming 
acceptable  to  collaborative  partners.  It 
is  important  to  protect  U.S.  companies 
from  losing  control  of  their  intellectual 
property  rights.  Legal  personnel  should 
assist  here. 

Third-party  sales  can  be  a  thorny  issue 
in  production,  although  it  is  also  included 
in  engineering  and  manufacturing 
development  MOUs.  The  United  States 
generally  insists  on  veto  power  in  this  area, 
though  caveats  (stating  that  a  veto  would 
not  be  invoked  if  the  partner  in  question 
would  sell  a  similar  item  to  the  target  coun¬ 
try  itself)  can  be  included.  Unfortunately, 
the  State  Department  reviews  these  on  a 
case-by-case  basis,  and  the  countries  on 
the  no-sale  list  vary  over  time. 

The  United  States  is  usually  the  only 
one  to  object  to  these  sales,  but  not 
always.  Embedding  U.S.  or  coopera¬ 
tively  developed  items  into  a  foreign 
platform  can  detract  significantly  from 
their  competitiveness.  Swedish  fighter 
sales  were  held  hostage  due  to  U.S. 
component  export  license  requirements. 

Indeed,  one  must  run  interference  with 
the  State  Department  for  the  shipment  of 
collaborative  components  between  part¬ 
ner  nations  for  incorporation  into  the 
integrated  product.  Export  licenses  will  be 
required.  It  is  possible,  however,  to  nego¬ 
tiate  a  blanket  export  agreement  with  the 
State  Department  before  the  fact.  Service 
laboratories  also  must  be  coordinated; 
export  licenses  have  been  hampered  in  the 
past  when  a  laboratory  was  asked  to 


evaluate  technology  export  unbeknownst 
to  the  program  manager. 

Some  programs  use  a  coordinating 
committee  to  control  third-party  requests. 
Such  a  group  could  function  as  an  OIPT, 
with  State  and  Commerce  Department 
members,  to  facilitate  approvals.  Also,  it 
may  be  possible  to  negotiate  with  State 
for  a  “quick  look  report”  on  proposed  re¬ 
leases,  consortia  agreements,  RFPs,  or 
technical  assistance  agreements  to  speed 
up  the  process.  Other  possibilities  include 
leasing  and  licensing  (one  example  of  this 
is  the  multiple  launch  rocket  system  for 
Japan). 

MOU  NEGOTIATIOilS 


It  pays  to  plan  ahead.  Find  people  with 
an  international  background  and  the 
necessary  technical  and  management 
expertise,  and  line  up  a  professional 
negotiator  and 
lawyer.  Get  cur¬ 
rent  data  on  mamth 

each  country’s  i#  ImI 
recent  negotia-  ip«rt  •• 
tions  history  ••Iwihm.*'' 
and  identify  a 
solution  in  ad¬ 
vance.  Often,  “if  no  one  has  an  alterna¬ 
tive,  you  win.”  The  initial  draft  (with  back¬ 
up  rationale)  is  the  going-in  position,  but 
one  should  also  prepare  contingency  plans, 
acceptable  ranges  of  outcomes,  and  a  “best 
alternative  to  a  negotiated  agreement” 
(Fisher  and  Ury,  1983).  It  helps  if  acqui¬ 
sition  personnel  have  people  and  negotia¬ 
tion  skills.  “We  can’t  afford  potty  training” 
for  expensive  programs:  “Come  equipped 
with  the  tools  to  do  the  job.”  A  politically 
sensitive  strategy  must  be  devised  and 
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major  strategy  changes  must  be  avoided. 
Rather  than  a  group  with  divergent  inter¬ 
ests,  one  needs  a  small,  coordinated  team. 
The  resulting  “comprehensive  vision”  and 
coherent  view,  ready  for  an  opportunity 
to  open,  “won  the  day  time  after  time.” 

During  negotiations  (as  in  running  an 
SC  or  IPO),  attempt  to  establish  mutual 
trust  through  personal  relationships.  Don’t 
try  to  intimidate;  “don’t  be  Attila  the  Hun.” 
Compromise  as  necessary.  “Trust  is  a  two- 
way  street.”  “Everyone  needs  to  feel 

they’re  part  of 
the  solution.” 
Avoid  being  la- 
g«i  beled  “uncoop- 

mqmm  wmqk  erative.”  The 


United  States 
usually  pro- 
vides  admlnis. 
Mive  support 
Beware  of  trans¬ 
mission  prob¬ 
lems  (phones,  facsimile,  e-mail)  and  the 
limitations  of  the  partners.  Provide  soft 
(electronic)  copies  so  they  can  adjust  the 
verbiage  as  needed.  The  goal  is  to  “create 
a  winnable  program”  for  all  the  players. 
Scheduling  sessions  will  be  a  continuing 
problem,  so  schedule  them  as  far  in  advance 
as  possible.  Lack  of  continuity  of  negotia¬ 
tors,  both  foreign  and  American,  will  prob¬ 
ably  plague  the  process.  It  is  recom¬ 
mended  that  sessions  be  held  monthly.  The 
number  of  sessions  generally  equals  the 
number  of  countries. 

It’s  best  to  divide  the  effort  into  “doable 


chunks”  similar  to  evolutionary  acquisi¬ 
tion.  Don’t  get  stuck,  move  on;  seek  later 
tradeoffs  or  unknown,  evolving,  integra¬ 
tive  solutions.  For  instance,  funding  or 
work  share  can  be  temporarily  “fenced  off” 
for  later  discussion.  “Steer  the  language 


through  terrain  obstacles,”  and  modify  the 
principles  of  cooperation  if  necessary. 

But  do  not  revisit  prior  MOU  agree¬ 
ments;  times  have  changed  and  the  climate 
differs.  Partners  may  bring  up  every  con¬ 
cession  the  United  States  ever  made  on 
any  and  all  prior  negotiations.  So  avoid 
setting  new  precedents  for  their  later  use: 
For  example,  don’t  go  above  the  AWACS 
41.5  percent  cost  share.  Breaking  new 
ground  will  have  future  consequences. 
Nonetheless,  it  may  help  to  ask  another 
nation  to  draft  a  proposal  and  then  defend 
it.  One  then  has  buy-in  and  is  not  seen  as 
the  constant  driver  of  the  process.  This 
technique  often  exposes  heated  differences 
as  mere  linguistic  difficulties.  When  an¬ 
other  country  proposes  verbiage  that 
seems  identical  to  what  the  United  States 
previously  proposed,  never  say  “that’s 
what  we  said  before.”  Just  thank  them  for 
clarifying  the  issue.  Most  of  all,  don’t  lose 
sight  of  the  goal. 

MOUApproviu. _ 

Kwatnoski  (1995)  noted  that  “nearly  all 
the  U.S.  project  offices  identified  the  cum¬ 
bersome  MOU-MOA  (Memorandum  of 
Agreement)  process  as  a  barrier  to  coop¬ 
eration,  including  complaints  about  staff 
coordination  differences  and  the  time  it 
took.”  Times  are  often  significantly 
underestimated,  especially  when  higher 
level  changes  necessitate  reopening 
negotiations.  Reviewers  have  their  own 
agendas.  DSCA,  with  a  vested  interest  in 
foreign  military  sales  versus  ICRADs,  can 
harm  a  program  (the  MLRS  suffered  this 
fate). 

Similarly,  the  Defense  Threat  Reduc¬ 
tion  Agency,  the  National  Security 
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Agency,  and  the  Departments  of  Com¬ 
merce  and  State  will  also  review  the  MOU, 
greatly  lengthening  the  process.  Prepro¬ 
cessing  choreography  can  provide  an 
ounce  of  prevention,  however.  Unfortu¬ 
nately,  acquisition  reform  has  not  yet 
improved  the  chop  review  cycle  much, 
except  in  OSD,  where  the  average  review 
time  has  significantly  declined.  Beware 
that  “sometimes  the  wrong  people  are 
staffing  the  problem.”  A  silence  procedure 
is  needed  for  all  parties  concerned,  and 
an  OIPT  could  be  very  useful  as  well. 

Finally,  don’t  negotiate  if  a  program 
doesn’t  have  a  pressing  Service  need  and 
is  already  in  the  POM — ^if  not  in  the  Future 
(formerly  Five)  Year  Defense  Plan. 

SnaiHC  CowMimi  Opiratioiis 

SC  membership  is  somewhat  enig¬ 
matic.  Sometimes  the  U.S.  member  will 
have  the  highest  rank  and  the  smallest 
authority.  Most  other  nations  have  much 
smaller  bureaucracies  and  avoid  micro- 
management.  Hopefully,  the  MOU  will 
apportion  considerable  authority  to  the 
SC.  The  U.S.  member  should  have  at  least 
as  high  a  rank  as  the  other  members, 
despite  the  fact  that  one  cannot  control 
who  else  serves  on  the  SC,  and  “every¬ 
body  wants  to  come  to  the  United  States.” 
Assuming  the  MOU  appoints  the  United 
States  as  the  host  nation,  the  SC  will 
normally  elect  the  U.S.  representative 
to  chair  the  SC.  In  most  circumstances, 
majority  does  not  rule;  each  nation  has 
veto  power.  Therefore,  the  chair  needs 
finely  honed  people  skills  or  it  “may 
take  forever  to  do  anything.”  Especially 
avoid  going  in  “with  extra  baggage, 
stereotypes,  or  prejudices.”  Rather,  “be 


prepared  to  listen  and  learn;  be  open 
minded;  have  fun.” 

International  experience  and  negotia¬ 
tion  skills  can  help  minimize  politics  and 
maintain  a  professional  atmosphere.  It’s 
important  to  establish  a  culture  of  coop¬ 
erative  problem  solving  rather  than  one 
of  competition,  so  that  all  members  feel 
they  are  full  participants.  Familiarity  can 
breed  mutual  respect.  Experience  with 
group  dynamics  can  help  the  chairperson 
establish  a  col¬ 
legial  partner- : 
ship  (Jacobs 

and  Jacques,  &  ^  Ttljm  ■ 

1986)  in  which 

the  members  |p|^. 

support  each  fc*,  ^*1* 

other  and  feel 

safe  enough  to 

openly  express 

their  nation’s  core  concerns  and  issues. 
Similarly,  the  chair  needs  to  work  the 
external  environment  well  (i.e.,  public 
relations)  for  continued  support  of  the 
program.  Strangely,  to  obtain  a  uniform  SC 
vision,  the  chair  must  understand  the  many 
cultural,  personal,  time  sense,  and  techno¬ 
logical  differences.  For  instance,  the  tech¬ 
nical  to  management  ratio  of  SC  members 
may  vary  considerably.  International  team 
building  is  a  challenge. 

The  one  team  member  that  the  chair  can 
appoint  is  the  executive  secretary  (ES), 
who  administers  SC  operations.  This 
position  is  important  since  “he  who  writes 
the  results  of  the  meeting  determines  its 
outcome.”  Also,  the  ES  prepares  the 
agenda,  which  should  be  pertinent  to  the 
program  and  avoid  extraneous  issues. 
Succinct  minutes  should  include  attendee 
list,  action  items,  agreements,  slides  not 
available  for  handout  at  the  meeting,  and 
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I.  Before  the  meeting  (United  States  as  host) 

A.  Correspondence 

1 .  Read-ahead  package:  Agenda,  preparation  items;  prior  action  items  (AIs);  location 
and  room 

a.  Avoid  acronyms;  date  and  number  pages  or  identify  same  as  ahead  package 

b.  Make  extra  copies  for  duplication  into  meeting  handout  packages 

2.  Attendance  list  for  meeting 

3.  Security  clearances  (if  meeting  is  classified,  need  foreign  visitor  request  forms) 

B.  Reception  planning 

1.  Reception  attendance  list,  including  contractors 

2.  Official  representation  funds  (ORF)  request  letter 

3.  Location  choice,  deposit,  reservation 

4.  Cost  analysis  and  distribution 

5.  Invitations:  Write  and  send;  contribution  addendum? 

6.  Contractor  reception?  U.S.  attendees? 

C.  Presentations:  Transparencies  and  hard  copies 

1 .  Current  action  items  with  spaces  for  additions 

2.  PEO  pitch:  Avoid  acronyms  and  idioms;  prepare  a  bio  and  introduction  for  any  new 
participants 

3.  IPO  pitches  and  read-ahead  items;  MIDSCO? 

D.  Room  selection:  Consider  number  of  participants  when  chosing  size  and  shape 

1.  Arrangement  of  furniture  (including  coffee  table):  in  back  and  near  door 

II.  For  the  meeting  (prepare  just  beforehand) 

A.  Handouts  (take-along  packages):  Avoid  acronyms  and  idioms 

1.  Looseleaf  books  with  decal  markings  and  members’  names 

a.  Numbered  dividers  matching  the  agenda 

b.  Inserts:  Agenda,  table  of  contents,  current  action  items  with  blank  spaces 

c.  Read-ahead  package  updates  and  additions:  Reports,  pitches  with  date  and  page 
number 

d.  Appendices  if  required 

2.  Welcome  packages:  Maps,  brochures,  metro  information 

3.  Sign-in  sheets  (“please  print”)  with  headers  and  latest  data  on  members 

B.  Security 

1 .  Foreign  visitor  request  forms  (to  host  activity  security  office) 

2.  Pre-made  badges  (visitor  control  office) 

3.  Escorts  for  foreign  guests 

C.  Room  setup 

1.  National  flags,  participant  placement 

2.  Numbers  of  chairs  at  table  and  against  wall;  arrangement  of  furniture 

3.  Coffee,  pot,  filters,  cups:  location  in  relation  to  tables,  doors 

4.  Doughnuts,  cookies,  and  cold  drinks  (for  the  afternoon) 

5.  Vu-Graph  machine,  screen,  blank,  elex  slides,  marker  pens,  MOU,  pointer 

6.  Calculator,  computer,  printer,  MOU,  elex  slides,  power  availability 

7.  Blank  slides  and  slide  markers;  pointer 

III.  At  the  meeting:  Action  items,  decisions,  cleanup  (coffee  pot,  etc.,  at  end  of  each  day) 

IV.  After  the  meeting:  Minutes,  attendance  list,  AIs,  next  meeting  time  and  location,  decisions 
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little  else.  Other  items  are  generally  “a 
waste  of  time  and  money.” 

The  ES  must  be  sensitive  to  time  dif¬ 
ferences  between  the  U.S.  coasts  and  the 
foreign  members.  Opportunities  for  phone 
calls  and  video  teleconferencing  are  lim¬ 
ited,  and  Federal  Express  deliveries  to  spe¬ 
cific  individuals  within  other  countries  can 
be  elusive.  Some  principals  may  not  have 
reliable  e-mail,  and  posted  mail  takes 
forever.  Thus,  many  programs  rely  on 
facsimiles.  Sometimes  members  trade 
home  phone  numbers.  It’s  important  for 
the  ES  to  provide  signup  sheets  for  each 
meeting,  since  numbers  and  titles  change 
continually.  These  can  be  pre-printed  with 
room  for  corrections.  A  sample  checklist 
for  host  nation  meetings  is  shown  in  the 
box  on  the  following  page. 

Meetings  held  in  other  nations  would 
require  a  subset  of  these  actions,  with 
added  actions  for  area  clearances  and 
other  issues.  Some  nations  that  require 
no  visa  for  tourists  do  require  one  for  those 
traveling  on  official  passports.  U.S. 
Embassy  Offices  of  Defense  Cooperation 
will  usually  make  hotel  registrations  for 
official  visitors  (they  get  better  rates).  On 
some  programs,  the  principals  even  put 
up  visitors  in  their  homes  or  have  social 
events  for  the  SC.  Generally,  the  hosting 
nation  (for  a  particular  meeting)  will  host 
one  social  event  for  the  principals,  depu¬ 
ties,  and  sometimes  other  attendees. 
Welcome  packages  with  local  event, 
travel,  and  restaurant  information  are 
normally  provided.  The  ES  should  verify 
what  equipment  (such  as  computers,  word 
processors,  printers,  fax  machines,  and  vu- 
graphs)  will  be  provided  at  the  meeting. 

The  chair  needs  to  “lead,  not  just  run 
the  meetings;  to  work  the  hard  issues.”  To 
maintain  a  corporate  perspective,  the 


mmfwiupmm 
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principal  needs  to  strategize  with  group 
members:  deputy  SC  member,  program 
manager,  and  ES.  Each  may  be  asked  to 
draft  inputs  for  the  meeting.  Often  one  of 
the  inherent  costs  of  ICRADs  is  training 
the  internationals — whether  in  the  SC  or 
IPO.  While  some  of  this  is  necessarily  on- 
the-job-training,  SC  meetings  should  be 
used  to  “consider  issues,  not  to  inform  the 
members.”  Read-ahead  packages  should 
be  sent  so  that 
members  are  in- 
formed  of  de¬ 
tails  prior  to 
the  meeting. 

Though  drafts 
may  be  sent 
ahead  for  re¬ 
view,  always 
bring  copies  to 

hand  out  at  the  meeting.  Important  items 
can  also  be  included  in  the  minutes. 

The  meeting  itself  should  be  run  as  a 
board  of  directors  meeting,  with  a  high 
level  of  abstraction.  Technical  issues  can 
be  delegated  to  a  multinational  manage¬ 
ment  coordination  group,  under  the  pro¬ 
gram  manager,  which  reports  to  the  SC. 
The  SC  should  also  avoid  micromanaging 
the  program  manager  or  the  IPO.  Both  for¬ 
mality  and  the  number  of  attendees  should 
be  limited  (one  program  had  100  attend¬ 
ees!).  Meetings  can  be  broken  into  parts: 
principals-only  sessions  and  plenary  ses¬ 
sions.  During  the  SC  meeting,  “Who 
speaks  first  matters.  Know  which  coun¬ 
tries  have  similar  positions  and  arrange  the 
order  of  speaking.”  It’s  best  to  go  last.  “If 
the  United  States  votes  fu*st,  [the  other 
members]  tend  to  vote  against  the  United 
States.”  “Avoid  flexing  your  muscles.” 
Clearly  identify  and  record  open  and 
closed  issues  and  agreements.  Above  all. 
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avoid  public  infighting.  If  disagreements 
appear  among  U.S.  attendees,  call  a  recess. 

The  contractor  should  be  invited  to 
speak,  but  must  avoid  implying  that  he  or 
she  represents  the  United  States.  Europe¬ 
ans  have  much  closer  interrelationships 
with  their  contractors,  and  they  may  not 
realize  the  difference  while  listening  to  the 
contractor’s  report.  The  program  manager 
should  provide  a  government  view  of  the 
contractor’s  performance.  While  nations 
may  play  one  principal  off  against  the 
other,  appreciate  the  differences.  “Differ¬ 
ences  don’t  equal  right  or  wrong.”  And 
remember,  “you  gotta  have  fun!” 

iNnRNATioNAL  Program 
Officer  Okrations 


Many  of  the  issues  asynchronously 
confronting  the  SC  chair  synchronously 
confront  the  program  manager,  making  it 
a  frustrating  full-time  job.  While  “it’s 

orders  of  mag¬ 
nitude  more  dif¬ 
ficult  to  have  an 
IPO  than  a  ma¬ 
jor  U.S.  pro¬ 
gram,”  say  pro¬ 
gram  staff,  “fa¬ 
miliarity  breeds 
appreciation.” 
For  small  programs,  added  costs  may  not 
justify  an  IPO,  but  there’s  a  huge  differ¬ 
ence  between  “an  integrated  office  versus 
token  representatives.”  An  IPO  can  bring 
“a  sense  of  family”  to  a  program.  The  pro¬ 
gram  manager  can  promote  this  climate 
by  showing  “loyalty  to  the  project  versus 
your  countiy  [to]  promote  allegiance  from 
others.”  If  successful,  “you  don’t  hear  their 
accents  anymore”  (Klisch,  1997). 


Technicai  Iuues 

While  DBAs  rarely  lead  to  MOUs  (one 
did  for  Trimarran),  DBAs  are  recom¬ 
mended  while  a  program  is  becoming  a 
reality  and  even  after  the  MOU  is  signed. 
They  provide  a  convenient  way  to  com¬ 
municate.  Furthermore,  personnel  gain 
valuable  international  on-the-job  training. 
Similarly,  the  Engineer  and  Scientist 
Exchange  Program  and  international 
military  exchange  training  can  provide 
personnel  experienced  in  working  with 
allies  on  technical  and  operational  issues. 
Prior  to  MOU  approval,  personnel  should 
finalize  technical  requirements  (see  above) 
and  translate  them  into  working-level 
documents.  Most  especially,  the  interface 
control  documents  must  be  collaboratively 
generated.  Be  aware  that  technology 
transfer  issues  may  be  more  difficult  than 
envisioned.  Use  of  U.S.  laboratories  may 
be  limited  to  host  nation  support  unless 
foreign  laboratories  can  provide  balanc¬ 
ing  support  (and  an  independent  view). 
Use  of  support  contractors  and  federally 
funded  R&D  centers  may  also  be  limited 
because  of  funding.  IPO  operations  can 
be  streamlined  through  electronic  media 
and  other  acquisition  reform  measures. 

Financiai  Issues 

As  in  all  programs,  funding  continuity 
is  a  challenge  in  the  United  States.  With 
several  cash  flows  (from  different  coun¬ 
tries)  to  manage,  ICRADs  do  increase  the 
financial  manager’s  burden.  As  stated 
above,  funding  is  more  solid  if  based  on  a 
core  Service  requirement.  “Service  people 
don’t  care  that  you  have  an  international 
MOU;  they  only  care  about  their  pet 
projects.”  One  program  had  its  Service 
funds  pulled  2  days  before  the  MOU  was 
signed.  If  Nunn  funds,  for  example,  are 
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used  to  start  a  program  without  strong  sup¬ 
port,  future  funding  streams  are  imperiled. 

Even  with  strong  DoD  and  Congres¬ 
sional  support,  programs  such  as  the 
mobile  extended  air  defense  system  have 
had  rocky  fmancial  pictures.  Nunn  funds 
are  usually  provided  for  only  2  years  and 
must  be  spent  in  the  United  States.  Pro¬ 
gram  funds  (especially  for  joint  programs) 
are  sometimes  funded  by  DoD  versus  the 
Services  (e.g.,  MIDS  terminal),  which  can 
help  to  fence  funding  lines.  As  always,  the 
program  manager  and  program  executive 
officer  must  be  strong  program  advocates 
to  maintain  program  continuity.  Having  a 
discrete  reserve  or  engineering  change 
proposal  account  is  highly  advisable. 

Antithetically,  foreign  funding  is  much 
more  stable — ^but  foreign  funds  have  their 
own  problems.  Conversion  rates  can  affect 
overruns  and  losses  and  add  risk  to  funding 
profiles.  De-escalation  indices  are  very 
difficult  to  negotiate  if  they  are  not  pre-set 
in  the  MOU.  Business,  accounting  conven¬ 
tions,  and  tax  structures  all  can  differ.  All 
known  national  budget  processes  are  out 
of  phase  with  the  United  States’  October 
1  fiscal  year  starting  date  and  planning, 
programming,  and  budgeting  system  cycles, 
and  “the  normal  U.S.  system  does  not 
accommodate  international  transactions 
well.” 

It’s  best  to  get  payment  in  dollars,  but 
if  that  is  not  possible,  get  an  internation¬ 
ally  experienced  bank  or  accounting  firm 
to  handle  financial  transactions  and  cur¬ 
rency  conversions.  It  can  also  help  to  have 
the  nations  send  funds  directly  to  the  con¬ 
tractor.  Many  countries  (Britain  among 
them)  are  much  more  flexible  at  export¬ 
ing  funds,  but  in  the  United  States,  it  is 
“hard  to  send  money  overseas.”  As  an 
alternative,  the  United  States  can  provide 


test  gear  or  used  equipment  or  other  items 
to  avoid  sending  dollars  abroad. 

The  financial  manager  will  need  to 
follow  up  on  deposits  and  expenditures — 
don’t  assume  they  will  occur  as  planned. 
Beware  that  large  checks  can  sometimes 
appear  in  the  mail — ^with  your  name  on 
them!  A  finan¬ 
cial  manager  in 

each  nation  may  "Wii«n  •Msoilnii 

be  needed  to 

help  develop  M'»  ®**P*rt<“** 

methods  to  tai- 

cedures  in  each  ««*•." 

country.  An  SC- 
approved  finan¬ 
cial  procedures  document  can  provide  con¬ 
tinuity  of  method  over  the  life  of  a  pro¬ 
gram.  Of  course,  the  size  (ACAT)  of  the 
program  will  dictate  how  elaborate  proce¬ 
dures  need  to  be.  Remember,  however, 
that  “losing  money  doesn’t  take  any  great 
skill — anybody  can  lose  money.” 

When  obligating  and  expending  funds, 
it’s  important  to  differentiate  between 
common,  host  nation,  and  national  costs. 
Make  sure  checks  are  made  out  right  and 
not  lost.  The  system  is  bureaucratic,  but 
not  automatic.  Foreign  funds  may  be 
designated  “operations  and  maintenance” 
or  “production,”  but  the  usual  rules  (e.g., 
expiration  dates)  do  not  apply.  Comptrol¬ 
ler  personnel  may  need  to  be  reminded  of 
this  peculiarity.  While  the  United  States 
obligates  funds,  then  pays  when  billed  by 
the  contractor,  other  countries  may  have  a 
work-first,  get-paid-later,  or  a  pay-bills- 
up-front  approach.  Such  differences 
should  be  accommodated  in  the  financial 
procedures  document.  It  can  also  be  used 
to  institutionalize  contingencies  for 
inflation,  unit  cost  changes,  or  unit  vol- 
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ume  changes.  Differences  in  fiscal  years 
can  sometimes  be  used  to  add  flexibility 
to  funding  and  cash  flow.  Using  work- 
share  banding  for  contractors  and  field  ac¬ 
tivities  can  increase  vital  flexibility  which 
may  become  critical,  since  getting  useful 
cost-schedule  reporting  data  can  be  a  tre¬ 
mendous — and  expensive — challenge.  On 
the  bright  side,  “no  one  looks  at  non-U.S. 
funds  in  the  DAES  [Defense  Acquisition 
Executive  Summary,  an  AC  AT  I  report  to 
DoD]  report.” 


CONTRACTUAI  ISSUES 

While  it’s  best  to  have  a  real  prime 
contractor  with  experience  (e.g.,  Hughes 
for  the  evolved  Sea  Sparrow  missile),  many 
programs  end  up  with  a  unique  consortium 
(e.g.,  MIDSCO  for  the  multifunctional 
information  distribution  system  (MIDS) 

Consortium  Or- 
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ganization. 
Contractually, 
pure  competi¬ 
tion  obtains  the 
best  price,  but 
the  nations  will 
want  to  divide 
up  work  share 


among  a 
selected  group  (usually  one  company  per 
countiy).  It  may  be  possible,  however,  to 
have  competing  primes  enlist  their  own 
subcontractors  within  the  partner 
countries.  Indeed,  a  particular  company 
can  be  split  up  by  a  “Chinese  Wall”  so 
that  different  divisions  join  different  trans¬ 
atlantic  teams  without  sharing  bidding 
information.  To  better  accomplish  this, 
MEADS  formed  “transatlantic  interna¬ 


tional  entities.”  Of  course,  losing  bidders 
may  mean  losing  some  of  the  best 
subcontractors,  but  this  is  just  as  true  in 


domestic  team  bids. 

Rigid  work-share  percentages  preclude 
needed  flexibility  and  are  unrealistic  con¬ 
sidering  the  vagaries  of  time  and  pro¬ 
grams.  It’s  best  to  provide  the  prime  con¬ 
tractor  with  subcontracting  flexibility  and 
empowerment  to  ensure  that  a  work-share 
target  (within  specified  bounds)  is 
achieved.  An  award  or  incentive  fee  can 
be  imposed.  “Assigning  work  is  dicey.” 
Care  must  be  taken  that  performers  have 
the  capability  and  expertise  to  efficiently 
and  effectively  perform  the  tasks  assigned 
them.  They  should  not  receive  work 
merely  because  they  desire  it. 

Europeans  usually  employ  fixed- 
price  contracts;  their  budget  system 
reflects  this.  U.S.  cost-plus  contracts 
present  a  major  risk  if  not  understood. 
Cost  schedule  reporting,  design  to  cost, 
and  life-cycle  cost  may  be  unfamiliar 
concepts  as  well. 

Protest  mechanisms  (e.g.,  by  the  Gen¬ 
eral  Accounting  Office)  should  be  delin¬ 
eated  prior  to  issuing  the  solicitation. 
Acquisition  reform  efforts,  such  as  com¬ 
mercialization,  can  somewhat  offset  such 
problems  and  can  lower  risks.  The  many 
differences  underscore  the  difficulty  in 
obtaining  foreign  expertise  in  U.S.  con¬ 
tracting.  NATO  contracting  is  possible,  but 
seldom  desirable.  But  the  use  of  contract 
innovations  can  be  quite  helpful.  Compa¬ 
nies  can  establish  facilities  on  foreign  soil; 
international  credit  arrangements  can  be 
devised;  or,  perhaps,  work  share  could  be 
pooled  in  a  group  of  projects  or  contracts. 

Most  important  is  to  “create  an  envi¬ 
ronment  the  contractor  can  win  in;”  and 
avoid  close  supervision  and  continual 
“help”  (like  DoD  sometimes  receives  from 
the  legislature).  For  instance,  allow  the 
prime  to  work  out  conversion  and  escala- 
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tion  rates  with  subs.  Obtain  exemptions, 
waivers,  or  deviations  to  help  the  program. 
Recent  developments  such  as  the  McCain 
Amendment  can  help  with  the  Buy 
America  Act.  Often  there  are  ways  to  work 
around  technical  export  restrictions, 
specialty  metals  clauses,  and  other  regu¬ 
latory  difficulties.  Unfortunately,  despite 
the  Administration’s  efforts,  U.S.  export 
license  reviews  remain  a  lengthy  process. 
Learning  curve  delays,  however,  can  be 
eased  through  out-sourcing,  but  keep 
support  contractors  to  a  minimum.  It’s  dif¬ 
ficult  to  get  them  (and  even  DoD  labora¬ 
tories)  included  as  common  (shared)  costs. 
Issues  should  be  resolved  in  the  IPO  if  at 
all  possible.  Minimize  issues  passed  up 
to  the  SC  for  resolution;  otherwise  expect 
significant  time  delays.  A  management 
coordination  group  can  help  resolve  issues 
before  this  occurs. 

Personnei  Issues 

IPOs  require  personnel  who  can  handle 
more  ambiguity  (Jacobs  and  Jacques, 
1986).  One  of  the  ways  to  lessen  ambigu¬ 
ity  is  to  define  roles  that  people  can  “own,” 
rather  than  having  them  merely  serve  as 
national  liaisons.  One  can  try  to  obtain 
experienced  people  to  avoid  much  on-the- 
job-training,  but  it’s  “hard  to  find  U.S. 
personnel  qualified  for  cooperative  pro¬ 
grams,  let  alone  European  [personnel].” 
Despite  MOU  authorization  to  approve  all 
IPO  personnel,  the  program  manager  can 
reject  but  a  few  (at  most)  without  creating 
unacceptable  embarrassment. 

The  resulting  group  may  demonstrate 
great  variation  in  ability  and  training. 
Comments  from  participants  are  hardly 
enlightening:  “Everybody  wants  to  come 
to  the  United  States  so  you  can  get  then- 
best  people.”  “Only  a  few  of  them  are 
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willing  to  move  to  the  United  States;  there¬ 
fore,  there  are  small  selection  possibili¬ 
ties.”  Still  others  say  that  because  of  the 
vagaries  of  politics,  “they  don’t  always 
send  the  best  people.”  In  addition,  with 
smaller  organizations,  differences  in  levels 
of  detail  and  abstraction  between  GS-13 
and  Senior  Executive  Service  equivalents 
can  be  much  less  in  other  nations  as  can 
their  use  of  consensus  management. 
Despite  off-take 
(number  of  units 
procured)  and 
cost-share 
(amount  of 
funds  contrib¬ 
uted)  differ¬ 
ences,  partners  i 
generally 

choose  to  send  an  equal  number  of  people 
to  the  IPO,  most  of  whom  have  “little 
knowledge  of  U.S.  acquisition  and  con¬ 
tracting  methods.” 

In  addition,  foreign  military  and  civil¬ 
ian  personnel  are  subject  to  the  same  job 
rotations,  promotions,  and  retirements  that 
U.S.  staff  are,  so  that  staffing  the  IPO  can 
be  a  constant  problem.  Since  the  deputy 
program  manager  is  generally  from  a 
partner  nation,  the  program  manager  can¬ 
not  rely  on  a  civilian  deputy  to  take  care 
of  personnel  issues.  It  is  useful  to  appoint 
a  senior  U.S.  staff  member  with  supervi¬ 
sory  experience  to  help.  In  this  situation, 
it  is  best  to  use  experienced  managers. 
“Technical  expertise  is  a  bonus,  but  sound 
management  experience  is  a  must.”  Thus, 
it  is  also  best  to  “avoid  U.S.  people  who 
need  to  learn  acquisition” — ^there  will  be 
enough  internationals  needing  to  do  so.  It 
was  even  suggested  that  the  “United  States 
should  fully  staff  the  IPO  [using  host 
nation  support]  and  use  Europeans  as  you 
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can.” 

Less  extreme  solutions  are  also  avail¬ 
able,  however.  Certainly,  the  program 
manager  “needs  to  be  a  good  trainer,”  to 
understand  the  individual’s  strengths  and 
weaknesses,  and  to  perform  “situational 
supervision.”  In  addition,  European  per¬ 
sonnel  should  be  encouraged  to  arrive 
early  (especially  to  a  newly  formed  office), 
and  IPO  personnel  can  attend  numerous 
acquisition  courses,  including  interna¬ 
tional  courses  at  the  Defense  Systems 
Management  College.  Kwatnoski  stresses 
the  need  for  U.S.  personnel  to  understand 
international  agreements,  especially  those 
relating  to  intellectual  property  rights 
(1995).  Also,  the  program  manager  can 
get  the  whole  IPO  up  to  speed  on  impor¬ 
tant  issues  via  group  training  and  team 
building.  Group  trips  to  field  activities  can 
be  arranged  to  help  establish  a  shared 
knowledge  base,  and  foreign  sponsors  or 
training  communities  can  be  invited  to 
visit  the  IPO. 

Dissension  (e.g.,  argumentative  team 
members)  may  be  avoided  to  some  extent 
by  screening;  however,  problems  can  also 

be  avoided  if 
they  “live  to¬ 
gether,  so  honor 
is  not  on  the  line 
over  disagree- 
m  e  n  t  s  ” 
(D’Agostino, 
1996).  The  pro¬ 
gram  manager 
can  teach  by 
example,  dem¬ 
onstrating  give 
and  take  versus  trying  to  win  every  battle. 
The  goal  is  a  seamless  team  that  puts  the 
program  ahead  of  parochial  national  in¬ 
terests.  Residual  learning  curves  for  spe¬ 


cific  expertise  deficiencies  can  be  handled 
via  outsourcing.  A  fresh  view  can  be  quite 
helpful.  “Be  prepared  for  jealousy  from 
people  not  working  international  pro¬ 
grams,”  but  “don’t  miss  the  wind  of 
change.” 

Management  Issues 

International  programs  face  all  the  chal¬ 
lenges  of  domestic  programs  and  then 
some.  Certain  aspects  become  particularly 
important  in  multinational  groups.  “The 
international  acquisition  manager  is  a  con¬ 
sensus  builder  dealing  with  a  plethora  of 
naysayers  far  exceeding  that  found  in 
domestic  programs”  (Kwatnoski,  1995). 
To  instill  mutual  trust,  the  program  man¬ 
ager  must  display  a  win-win  attitude, 
instead  of  viewing  the  collaboration  as  a 
technical  giveaway.  The  goal  is  to  build  a 
group  culture  that  views  the  program  as 
shared,  with  the  internationals  as  co¬ 
workers,  and  to  avoid  a  culture  that  is 
national  in  flavor,  with  liaison  represen¬ 
tatives  viewed  as  outsiders.  “European 
members  must  be  equal  to  U.S.  people.” 
When  members  trade  home  phone  numbers, 
someone’s  doing  something  right! 

U.S.  members  need  to  avoid  a  bureau¬ 
cratic  mindset,  second-guessing  and 
micromanaging  other  players,  including 
contractors.  Unfortunately,  “the  European 
process  is  similar  to  U.S.  processes  five 
years  ago,”  and  “most  people  you  deal 
with  [in  the  United  States]  don’t  appreci¬ 
ate  the  international  program.”  For 
instance,  MIDS  had  problems  with  badges 
for  foreign  IPO  members,  especially  for 
after-hours  work.  The  program  manager 
had  to  invent  special  “Blue  Badges”  to 
identify  and  allow  after-hours  access  for 
international  IPO  members.  Also,  be 
aware  that  some  countries  don’t  have  a 
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“confidential”  classification,  so  they  have 
a  tendency  not  to  safeguard  confidential 
materials.  Furthermore,  management  is 
the  stock  and  trade  of  generalists;  “spe¬ 
cialists  can’t  be  allowed  to  run  the  pro¬ 
gram.”  Resist  being  handcuffed  with 
overly  detailed  requirements. 

Specific  expertise  can  be  retained  or 
enlisted  as  needed.  Resistance  exists  to 
using  only  U.S.  field  activities  or  feder¬ 
ally  funded  R&D  centers,  but  other  coun¬ 
tries  (such  as  Australia,  Canada,  and  the 
Netherlands)  also  have  them.  Of  course, 
the  size  of  the  program  is  important  for 
determining  IPO  size  and  structure,  the 
nature  and  oversight  of  the  contract(s), 
Congressional  visibility,  and  how  quickly 
things  might  be  accomplished  (e.g.,  the 
X-31  was  done  in  record  time).  Your 
schedule  risk  will  rarely  be  less  than 
medium;  however,  risks  can  be  mitigated 
through  the  use  of  preparation,  experience, 
and  training  (PET) — a  phrase  used  by 
Kwatnoski  (1992,  1995).  Recording 
lessons  learned  will  add  to  the  interna¬ 
tional  data  base  so  ICRADs  improve  in 
the  future. 

RiCOWIHIEIIIMmOMS  AND  CowausioNS 

If  the  United  States  is  serious  about 
international  cooperation  as  the  technique 
of  choice  for  the  future,  it  has  numerous 
opportunities  to  demonstrate  its  commit¬ 
ment.  First,  international  aspects  must  be 
fully  integrated  into,  and  in  some  cases 
drive,  requirements.  Similarly,  acquisition 
planning  should  include  the  assumption 
of  cooperative  development,  production, 
and  execution.  Likewise,  training  (formal 
and  on-the-job)  for  both  communities 


should  emphasize  cooperation.  Obviously, 
this  would  entail  a  major  shift  in  mindset 
as  well  as  procedure.  But  that  is  precisely 
what  the  world  is  presently  experiencing 
with  the  “relative  decline  of  American 
power  and  the  increase  of  global 
interdependence”(Jones,  1997). 

ICRADs  need  be  linked  to  interdepen¬ 
dent,  coalition  missions  with  the  com¬ 
manders  in  chief  and  joint  staff  fully 
engaged  if  such  climactic,  climatic 
changes  (as  described  above)  have  much 
chance  of  success.  Many  of  the  necessary 
changes,  fortunately,  follow  in  the  steps 
of  recent  trends  such  as  defense  acqui¬ 
sition  workforce  implementation  act 
certification,  joint  R&D  and  mission  plan¬ 
ning,  acquisition  reform,  and  empower¬ 
ment.  But  with  the  many  and  continuing 
“barnacles  on  the  ship  of  progress,”  it  will 
be  a  rough  ride. 

An  alarming  tendency  exists  in  the  land 
of  the  free  and  the  home  of  the  brave  to 
effect  change  by  fiat  rather  than  through 
motivation  and  guidance — continued 
protestations  of  the  pursuit  of  empower¬ 
ment  to  the  contrary.  The  powers  that  be 
might  consider  the  old  motto  of  the  Phila¬ 
delphia  Savings  Fund  Society:  “Wishing 
won’t  do  it,  saving  will.”  I  suggest  that 
the  top-down  approach  be  aimed  at  reduc¬ 
ing  and  eliminating  impediments  to  inter¬ 
national  cooperation  while  encouraging 
and  motivating  requirements,  operations, 
and  acquisition  personnel  to  engage  in  the 
cooperative  process.  Skills  +  Desire  = 
Product.  When  priorities,  prestige,  and 
promotions  go  to  those  succeeding  at 
international  cooperation,  you’ll  have  to 
search  for  another  problem.  Why?  Because 
without  problems,  they  wouldn’t  need  us! 
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LESSONS  LEARNED 


THE  IMPAQ  OF  THE 
PACKARD  COMMISSION'S 
RECOMMENDATIONS  ON 
REDUCING  COST  OVERRUNS 
ON  DEFENSE  ACQUISITION 
CONTRACTS 


David  S.  Christensen^  Ph,D.^  Capt  David  A.  Searie,  USAFf 
and  Dr.  Caisse  Vickery 


Using  data  from  selected  acquisition  reports,  Drezner  et  al.  (1993)  show  that 
reform  initiatives  from  1 960  to  1 990  did  not  reduce  cost  growth  on  1 97  defense 
programs.  The  average  cost  growth  on  these  programs  was  20  percent  and 
did  not  change  significantly  for  30  years.  Using  data  from  the  Defense 
Acquisition  Executive  Summary  data  base,  we  show  a  similar  result.  Initiatives 
based  on  the  recommendations  of  the  Packard  Commission  did  not  reduce 
the  average  cost  overrun  percent  experienced  on  269  completed  defense 
acquisition  contracts  evaluated  over  an  8-year  period  (1988  through  1995). 
In  fact,  the  cost  performance  experienced  on  development  contracts  and  on 
contracts  managed  by  the  Air  Force  worsened  significantly.  Although  many 
factors  contribute  to  poor  cost  performance,  estimation  error  Is  a  casual  factor 
identified  in  each  study. 


^^^resident  Ronald  Reagan  established 
H^the  Packard  Commission  in  1986  to 
I  reduce  inefficiencies  in  the  defense 
procurement  system.^  Although  the 
commission  examined  defense  manage¬ 
ment  practices  in  general,  it  focused  on 
the  acquisition  process.  The  commission 


concluded  that  the  primary  problems  with 
the  acquisition  process  were  the  same  ones 
identified  in  previous  decades  (cost  growth, 
schedule  delays,  performance  short¬ 
falls).  It  recommended  streamlining  the 
acquisition  process,  increasing  tests  and 
prototyping,  changing  the  organizational 
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culture,  improving  planning,  and  adopt¬ 
ing  the  competitive  firm  model  where 
appropriate.  Like  the  problems,  the 
recommendations  were  strikingly  similar 
to  reform  efforts  of  the  past  and  to  those 
of  the  present  (Dews,  Giles,  Barbour, 
Harris,  and  Hesse,  1979;  Gates,  1989). 

With  this  research  we  set  out  to  test  the 
effectiveness  of  the  Packard  Commission’s 
recommendations  on  reducing  defense 
cost  overruns.  As  similar  initiatives  are 
identified  and  implemented  today,  it  is 

important  for 


policy  makers 
to  understand 
the  effective¬ 
ness  of  past 
policies.  Based 
on  a  review  of 
269  completed 
defense  con¬ 
tracts,  we  found 
that  the  Packard 
Commission’s 
recommenda¬ 
tions  did  not  re¬ 
duce  cost  over¬ 
runs.  This  result  is  consistent  with  simi¬ 
lar  research  involving  an  analysis  of  cost 
growth  on  197  defense  acquisition  pro¬ 
grams  (Drezner,  Jarvaise,  Hough,  & 
Norton,  1993).  Despite  the  implementa¬ 
tion  of  more  than  two  dozen  regulatory 
and  administration  initiatives,  there  has 
been  no  substantial  improvement  in  the 
cost  performance  of  defense  programs  for 
more  than  30  years. 


"Despite  the 
implementation 
of  more  than  two 
dozen  regulatory 
and  administration 
initiatives,  there 
has  been  no  sub¬ 
stantial  improve¬ 
ment  in  the  cost 
performance  of 
defense  programs 
for  more  than  30 
years." 


liTERATURE  Review 


Unplanned  cost  increases  in  defense 
procurements  can  escalate  to  staggering 


amounts  and  can  adversely  affect  resource 
allocation  decisions,  especially  when 
defense  budgets  are  decreasing.  The 
Department  of  Defense  (DoD)  has  not 
ignored  this  problem.  As  shown  in  Table 
1,  Drezner  et  al.  (1993)  identify  several 
important  regulatory  and  administrative 
initiatives  to  improve  defense  cost 
performance.  The  expectation  was  that  as 
these  initiatives  were  implemented,  cost 
performance  would  improve  through  time. 

Unfortunately,  these  initiatives  did  not 
improve  defense  cost  performance.  Using 
data  from  the  DoD  Selected  Acquisition 
Report  (SAR),  Drezner  et  al.  (1993)  com¬ 
puted  the  average  cost  growth  on  197 
acquisition  programs  with  start  dates  from 
1960  through  1990.  Results  show  that  cost 
growth  fluctuated  around  20  percent,  with 
no  substantial  improvement  through  time. 

A  factor  contributing  to  defense  cost 
growth  is  estimation  error,  possibly  due 
to  excessive  competition.^  Contractors 
have  an  incentive  to  understate  initial  costs 
to  win  new  contracts.  Likewise,  because 
programs  compete  for  limited  resources, 
there  is  an  incentive  to  accept  low  esti¬ 
mates  as  reasonable.  Drezner  et  al.  (1993) 
could  not  test  this  assertion,  but  did  re¬ 
port  that  the  average  initial  cost  estimates 
were  systematically  understated.  This 
finding  is  consistent  with  results  reported 
by  others  (General  Accounting  Office 
[GAO],  1988;  Tyson,  Harmon,  &  Utech, 
1989;  McNichols,  McFarland,  KcKinney, 
&  Balut,  1984;  Christensen,  1994, 1996). 

There  are  two  weaknesses  with  Drezner 
et  al.  (1993).  First,  the  SAR  data  base  fo¬ 
cuses  on  defense  programs.  The  highly 
aggregated  nature  of  program  data  may 
mask  differences  that  may  otherwise  be 
apparent  at  the  contract  level.  Second,  the 
analysis  focuses  on  cost  growth,  defined 


252 


The  Impatt  of  the  Patkard  Commission's  Reiommendations  on  Reducing  Cost  Overruns 


Table  1.  Acquisition  Reguiations  and  Initiatives' 


Year 

Regulation  or  Initiative  Published 

1969 

Packard  Initiatives 

1971 

Blue  Ribbon  Defense  Panel  (Fitzhugh  Commission) 

1972 

DoDD  5000.1  (Major  System  Acquisitions);  Commission  on  Government 
Procurement 

1973 

DoDD  5000.4  (CAIG):  DoDD  5000.3  (T&E) 

1975 

DoDl  5000.2  (Major  System  Acquisitions);  DoDD  5000.28  (DTC) 

1976 

0MB  Circular  A-109 

1978 

Defense  Science  Board  Acquisition  Cycle  Task  Force 

1979 

Defense  Resource  Management  Study 

1981 

Carlucci  Initiatives;  Defense  Acquisition  Improvement  Program 

1982 

Nunn-McCurdy  (thresholds) 

1983 

Grace  Commission 

1985 

DoD  5000.43  (streamlining) 

1986 

Packard  Commission 

1987 

DoDD  5134.1  (USD(A);  DoDD  5000.49  (DAB) 

1989 

Defense  Management  Review 

1991 

Revised  DoDI  5000.2  (Major  System  Acquisitions) 

1994 

Federal  Acquisition  Streamlining  Act  (FASA) 

1995 

Federal  Acquisition  Improvement  Act  (FASA  II) 

’  Modified  from  Drezner  et  al.,  1993. 

as  the  difference  between  the  initial  budget  poor  control  techniques.  For  example, 
and  the  final  cost  of  the  program.  Cost  Czelusniak  and  Rodgers  (1997)  report  that 
growth  does  not  distinguish  between  Congressional  decisions  to  shift  funds  to 
uncontrollable  factors,  such  as  changes  in  near-term  priorities  external  to  a  program 
scope  or  technology,  and  controllable  (e.g.,  unplanned  contingency  operations 
factors,  such  as  inadequate  planning  or  in  Bosnia)  account  for  up  to  one-half  of 


253 


Acquisition  Review 


the  cost  growth  in  major  weapon  systems. 
Program  managers  cannot  control  this 
kind  of  cost  growth. 

Our  study  attempts  to  overcome  these 
weaknesses  by  analyzing  cost  overruns  on 
completed  defense  acquisition  contracts. 
A  cost  overrun,  defined  as  the  difference 
between  a  contract’s  final  budget  and  final 
cost,  is  a  more  appropriate  metric  for  mea¬ 
suring  the  impact  of  the  DoD  initiatives 
because  the  initiatives  focus  on  actions  that 


program  managers  can  influence,  such  as 

thorough  plan¬ 
ning  and  disci- 

final  budget  of  plined  control 


a  project  is  a  better  (McNaughter, 

estimate  of  what  a  1990).  Funding 

well-managed  instability  and 

blouse  IHncltdef' 

Ulh"rl*ed*  are 

changes  that  may  typically  be- 

nef  hove  been  yond  the  con- 

known  at  the  start  trol  of  program 

ef  a  contract."  managers  and 

lead  to  cost 
growth,  but  not 
necessarily  to  cost  overruns  (Christensen 
and  Gordon,  1998).  The  final  budget  of  a 
project  is  a  better  estimate  of  what  a  well- 
managed  contract  should  cost,  because  it 
includes  all  the  authorized  changes  that 
may  not  have  been  known  at  the  start  of  a 
contract. 


Another  difference  between  our  study 
and  Drezner  et  al.  (1993)  is  our  focus  on 
the  Packard  Commission’s  recommenda¬ 


tions.  Prior  initiatives  (e.g.,  McNamara, 
Carlucci)  had  been  ineffective  in  reduc¬ 
ing  cost  growth  (Dews  et  al.;  1979,  Gansler, 
1989;  Drezner  et  al,  1993),  and  current 
initiatives  (e.g.,  the  Federal  Acquisition 
Streamlining  Act  (FASA),  the  Federal 
Acquisition  Improvement  Act)  were 


building  on  the  framework  of  the  Packard 
Commission  initiatives  (Gates,  1989). 

Methodoiogy _ 

This  study  tests  whether  the  recommen¬ 
dations  implemented  as  a  result  of  the 
Packard  Commission  affected  the  cost 
performance  experienced  on  defense 
acquisition  contracts.  The  expectation  is 
that  cost  performance  would  improve  after 
implementation.  To  test  this  hypothesis, 
we  compared  the  average  cost  overrun  per¬ 
cent  on  populations  of  defense  contracts 
before  and  after  the  commission’s  recom¬ 
mendations  were  implemented  using  the 
nonparametric  Mann-Whitney  test  at  the 
10  percent  level  of  significance.^ 

The  hypothesis  was  tested  using  cost 
performance  data  on  269  contracts,  com¬ 
pleted  between  January  1, 1988,  and  De¬ 
cember  31,  1995.  The  8-year  period  pro¬ 
vided  for  approximately  four  years  before 
and  after  the  treatment  date  of  December 
31,  1991.  The  decision  to  use  four  years 
of  performance  data  before  and  after  the 
treatment  date  was  subjective,  but  seemed 
adequate  to  account  for  a  gradual  imple¬ 
mentation  of  the  commission’s 
recommendations. 

Based  on  assessments  made  by  the 
GAO,  we  chose  December  31,  1991,  as 
the  treatment  date.  In  1990,  the  GAO 
reported  that  efforts  to  implement  the 
recommendations  were  in  various  stages, 
with  some  initiatives  under  way,  and 
others  planned  for  implementation  in  the 
“near  term”  (GAO,  1990).  In  1991,  the 
GAO  reported  that  most  of  the  recom¬ 
mended  changes  had  been  made  and  the 
remaining  changes  would  be  completed 
in  the  “short  term”  (GAO,  1991). 
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The  average  cost  overrun  percent 
(CO%)  is  defined  as 

CO%  =  (Final  cost  -  Final  budget)  / 
Final  budget)  ¥  100  (1) 

Average  CO%  =  ?  (CO%)  /  n  (2) 

where  the  final  cost  and  budget  of  the 
contract  were  the  actual  cost  of  work 
performed  (ACWP)  and  the  budget  at 
completion  (BAC)  reported  by  the  con¬ 
tractor  on  the  last  cost  performance  report, 


and  n  is  the  number  of  contracts/  As  a 
relative  measure  of  cost  performance, 
CO%  adjusts  for  the  effects  of  inflation 
and  contract  size. 

The  monthly  cost  performance  report 
is  prepared  by  the  contractor  and  submit¬ 
ted  to  the  government  throughout  the  life 
of  the  contract.  Data  from  the  report  are 
stored  in  the  Defense  Acquisition  Execu¬ 
tive  Summary  (DAES)  data  base,  main¬ 
tained  by  the  Office  of  the  Secretary  of 
Defense.  At  the  time  of  this  study,  the  data 
base  contained  cost  information  from  378 


Table  2.  Summary  of  Contract  Data 


Before  Implementation  (1988-1991) 


Phase 


Development  Production 


Service 


Navy  Army 


Number  of  contracts  (n) 


Average  final  cost 
(millions  of  dollars) 

Standard  deviation 


Average  final  budget 
(millions  of  dollars) 

Standard  deviation 


Average  final  overrun 
(millions  of  dollars) 

Standard  deviation 


After  Implementation  (1992-1995) 


Number  of  contracts  (n) 


Average  final  cost 
(millions  of  dollars) 

Standard  deviation 


Average  final  budget 
(millions  of  dollars) 

Standard  deviation 


Average  final  overrun 
(millions  of  dollars) 

Standard  deviation 


Phase 

Service 

All 

Development 

Production 

AF 

Navy 

Army 

121 

34 

87  , 

49 

64 

8 

571 

768 

494 

724 

502 

190 

1121 

2011 

426 

1674 

465 

117 

511 

647 

458 

613 

476 

173 

935 

1661 

390 

1379 

438 

114 

60 

121 

36 

111 

26 

17 

274 

499 

84 

421 

69 

27 
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defense  acquisition  programs  encompass¬ 
ing  1,843  individual  contracts  from  1977 
through  1995.  The  reliability  of  the  data 
is  controlled  by  earned  value  management 
control  systems  criteria,^  a  DoD  require¬ 
ment  on  most  large  defense  contracts.  Vir¬ 
tually  all  of  the  data  in  the  DAES  data 
base  comes  from  criteria-compliant  con¬ 
tractors,  But  because  of  technical  prob¬ 
lems  with  the  data  base  and  our  focus  on 
completed  contracts,  we  could  only 
include  269  contracts  in  our  study.® 

We  also  evaluated  the  sensitivity  of  our 
results  to  contract  phase  (development, 
production)  and  managing  Service  (Army, 
Navy,  Air  Force).  Because  of  greater 
uncertainties,  the  cost  performance  on 
development  contracts  is  often  worse  than 
the  cost  performance  on  production 
contracts  (Christensen,  1994).  Given  the 


different  missions  and  requirements  of  the 
Army,  Navy,  and  Air  Force,  it  is  possible 
that  the  Packard  Commission’s  recom¬ 
mendations  were  implemented  differently 
across  the  Services.  Table  2  summarizes 
the  relevant  cost  data  on  the  contracts  used 
in  our  study.’ 

Results 


As  illustrated  in  Figure  1,  the  recom¬ 
mendations  of  the  Packard  Commission 
affected  cost  performance,  but  in  the 
wrong  direction.  Cost  performance  wors¬ 
ened  rather  than  improved  after  implemen¬ 
tation.  As  Table  3  shows,  the  average  final 
overrun  percentage  for  contracts  before 
implementation  was  5.6  percent.  After 
implementation,  the  average  final  overrun 


Figure  1. 

CpsI  Performance  Before  and  After  Implementing  Packard  Reforms 
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percentage  was  9.5  percent.  With  a p- value 
of  0.055,  this  change  is  statistically  signifi¬ 
cant  at  an  a  of  0.10.^ 

This  result  was  sensitive  to  contract 
phase.  The  cost  performance  on  the  sample 
of  development  contacts  worsened  from 
4.1  to  15,3  percent  (p  =  0.014).  The  cost 
performance  on  production  contracts  also 
worsened  from  6.2  to  12  percent,  but  the 
change  was  not  significant  {p  =  0.294). 

The  result  was  also  sensitive  to  the  mili¬ 
tary  service  that  managed  the  contract.  The 
average  cost  overrun  on  Air  Force  con¬ 
tracts  worsened  significantly  from  2.8 
percent  to  12.7  percent  {p  =  0.003).  The 
average  cost  overruns  on  Navy  and  Army 
contacts  did  not  change  significantly.  This 
was  true  regardless  of  contract  phase. 

Discussion 


Overall,  these  results  show  that  the 
Packard  Commission’s  recommendations 
did  not  improve  the  cost  performance  of 
defense  acquisition  contracts.  As  such,  the 
results  are  consistent  with  results  reported 
by  Drezner  et  al.  (1993).  Our  study  also 


shows,  however,  that  for  development  and 
Air  Force  contracts,  the  final  cost  overrun 
percentages  more  than  tripled  after  the 
recommendations  were  implemented.  In 
general,  development  contracts  are  more 
risky  than  production  contracts,  and 
appear  to  be  more  sensitive  to  policies 
affecting  cost  performance.  We  do  not 
know  why  the  cost  performance  of  Air 
Force  contracts  worsened  significantly, 
while  the  cost  performance  of  the  other 
Services  did  not  change  significantly. 
Although  the  Packard  Commission’s 
recommendations  were  to  be  implemented 
DoD-wide,  it  is  possible  that  each  Service 
implemented  them  differently.  Clearly, 
further  research  on  this  issue  is  needed. 

Drezner  et  al.  (1993)  also  reported 
strong  evidence  of  understated  initial 
budgets.  Based  on  the  same  data  base  used 
in  our  study,  Christensen  (1994,  1996) 
reported  that  the  predicted  final  cost  on 
defense  acquisition  contracts  is  also 
systematically  understated.  Thus,  not  only 
are  the  initial  budgets  understated,  but  the 
revised  estimates  of  final  cost  are  also 
understated  throughout  the  lives  of  most 
defense  acquisition  contracts.  Although 


Table  3. 

The  Effect  of  Packard  Commission  Recommendations 
on  Defense  Cost  Performance 


All 

Contracts 

Contract  Phase 

Managing  Service 

Development 

Contracts 

Production 

Contracts 

Air 

Force 

Navy 

Army 

Number  of  contracts  (n) 

269 

8 

188 

113 

134 

22 

Final  overrun  before 
implementation  (%) 

5.6 

4.1 

6.2 

2.8 

7.6 

8.1 

Final  overrun  after 
implementation  (%) 

9.5 

15.3 

7.2 

12.7 

6.1 

17.0 

Difference  (%) 

3.9 

11.2 

1.0 

9.9 

-1.5 

8.9 

Statistical  significance  ( p) 

0.055 

0.014 

0.294 

0.003 

0.206 

0.110 
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there  are  many  other  causal  factors  for 
poor  cost  performance,  it  is  apparent  that 
prior  policies  that  encourage  cost  realism 
have  been  ineffective. 

This  study  raises  some  concerns  regard¬ 
ing  the  appropriateness  of  current  reform 
initiatives.  Presently,  the  DoD  is  operat¬ 
ing  in  an  era  of  acquisition  reform.  The 
passing  of  the  FAS  A  in  1994  and  the  Fed¬ 
eral  Acquisition  Improvement  Act  in  1 995 
marked  the  first  major  revisions  of  acqui¬ 
sition  policy  since  the  Packard  Com¬ 
mission’s  recommendations.  A  review  of 
these  policies  indicates  striking  similari¬ 
ties  between  their  major  provisions  and 
those  of  earlier  reform  efforts,  including 
the  Packard  Commission  (Gates,  1989). 
Themes  such  as  streamlining,  decentrali¬ 
zation  of  authority,  empowerment,  and 
cultural  change  simply  re-emerge  in  a 
newly  packaged  policy.  Because  the  cur¬ 
rent  provisions  are  so  similar  to  prior 
reform  efforts  that  were  ineffective,  the 
DoD  should  not  realistically  expect 
improvements  in  cost  performance. 


Conclusion 


The  recommendations  of  the  Packard 
Commission  have  been  ineffective  in 
reducing  cost  overruns  on  major  defense 
acquisition  contracts.  Cost  performance  on 
development  and  Air  Force  contracts 
actually  worse  after  implementation  of  the 
commission’s  recommendations.  Estima¬ 
tion  error  was  identified  as  one  contribut¬ 
ing  factor,  but  additional  causal  factors  are 
possible.  We  recommend  that  the  impact 
of  more  recent  policy  changes  be  investi¬ 
gated.  The  FASA  of  1994  and  the  Federal 
Acquisition  Improvement  Act  of  1995  are 
the  fust  major  rewrites  of  government  pro¬ 
curement  regulations  in  a  decade.  Of 
course,  it  will  take  several  years  before 
the  cost  impact  of  these  initiatives  is 
known.  In  the  meantime,  a  comparison  of 
new  policies  with  prior  reform  efforts 
should  yield  insight  into  their  likely 
effectiveness. 
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Endnotes 


1 .  The  commission’s  formal  name  was 
the  “President’s  Blue  Ribbon  Com¬ 
mission  on  Defense  Management.” 
David  Packard  was  its  chairman. 

2.  Of  course,  estimation  error  is  not  the 
only  factor  contributing  to  unplanned 
cost.  Other  factors  often  cited  in  the 
literature  include  schedule  slips, 
changes  in  requirements,  improve¬ 
ments,  management  inefficiencies, 
and  organizational  culture  (Scott, 
1983). 

3.  The  parametric  t-test  failed  the  key 
assumptions  of  normality  and  equal 
variances.  For  a  description  of  the 
Mann-Whitney  test,  see  Conover 
(1980). 

4.  To  simply  the  technical  jargon,  we 
prefer  the  term  “cost  overrun”  to 
“adverse  cost  variance.”  An  adverse 
cost  variance  occurs  when  ACWP 
exceeds  the  flexible  budget,  termed 
the  “budgeted  cost  of  work 
performed”  (BCWP). 

5 .  EM V S  criteria  were  formerly  termed 
“cost/schedule  control  systems  crite¬ 
ria”  (C/SCSC).  In  1996,  the  criteria 
were  slightly  revised  and  renamed. 
Despite  the  multiple  names,  the  crite¬ 
ria  have  not  changed  significantly 
since  their  inception  in  1967. 


6.  A  contract  was  included  in  our  analy¬ 
sis  if  it  was  completed  within  the  8- 
year  period,  and  the  necessary  data 
were  available  (contract  phase, 
ACWP,  BCWP,  and  BAC).  The  DAES 
data  base  that  we  used  did  not  include 
classified  programs.  See  Searle  (1997) 
for  a  complete  listing  of  the  data  used 
in  this  study. 

7.  This  study  has  limitations  that 
threaten  its  internal  validity.  In  par¬ 
ticular,  political,  macro-economic, 
and  technological  events  may  have 
occurred  during  the  8  year-period  that 
may  have  influenced  contract  perfor¬ 
mance.  We  made  no  attempt  to  con¬ 
trol  for  such  events.  In  addition,  our 
sample  was  not  evenly  distributed 
across  the  Services,  with  only  8  per¬ 
cent  of  the  contracts  managed  by  the 
Army.  It  is  possible  that  the  uneven 
distribution  may  have  biased  our 
results. 

8.  All  hypothesis  tests  in  this  study  were 
directional  or  one-sided. 
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THE  IMPAQ  OF  THE 
BUY  AMERICAH  AQ  OH 
PROGRAM  MAHAGERS 

It  Col  Joseph  S.  Smythf  USJV 


The  Buy  American  Act  adds  another  layer  of  complexity  to  the  program 
manager’s  job,  especially  in  the  context  of  the  acquisition  reform  era. 
Reviewing  the  background  and  implementation  of  the  Act  will  give  both 
industry  and  government  managers  guidance  on  how  to  proceed  under  its 
restrictions. 


The  Buy  American  Act  has  been  a 
staple  of  federal  acquisition  since  its 
codification  on  March  3,  1933.  Its 
express  purpose  is  to  provide  a  preferen¬ 
tial  treatment  for  domestic  sources  of  un¬ 
manufactured  articles,  manufactured 
goods,  and  construction  materials.  The  Act 
is  of  concern  to  the  program  manager  be¬ 
cause  of  its  complicated  nature,  the  re¬ 
quirement  for  certification  of  compliance 
by  defense  contractors,  and  its  continued 
existence  in  an  era  of  acquisition  reform. 

This  article  provides  a  brief  background 
and  analysis  of  the  Act,  discusses  its  use 
as  a  protectionist  policy  tool,  and  consid¬ 
ers  the  impact  of  acquisition  reform.  The 
paper  will  then  discuss  the  limits  on  ac¬ 
tions  for  defense  managers  by  reviewing 
the  implementation  of  the  Act  in  the  Fed¬ 
eral  Acquisition  Regulations  (FARs)  and 
Defense  Federal  Acquisition  Regulations 


(DFARs),  and  provide  some  guidance  for 
both  government  and  industry  defense 
managers. 

Background  and  Analysis 


The  Buy  American  Act  (1933)  super¬ 
seded  an  earlier  1875  statute  that  “related 
to  preferential  treatment  of  American  ma¬ 
terial  in  contracts  for  public  improve¬ 
ments”  (1933,  Sect.  10).  The  Act  is  a  com¬ 
plicated,  somewhat  contradictory  law  that 
requires  careful  reading.  It  begins  with  a 
strong  requirement  for  acquiring  only 
American  materials  for  public  use  (Sect. 
10a),  and  using  only  American  materials 
for  construction  of  public  works  (Sect. 
10b).  Here  is  an  excerpt  from  Section  10a 
(emphasis  added): 
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Notwithstanding  any  other  provi¬ 
sion  of  law,  and  unless  the  head 
of  the  Federal  agency  concerned 
shall  determine  it  to  be  inconsis¬ 
tent  with  the  public  interest,  or  the 
cost  to  be  unreasonable,  only 
such  unmanufactured  articles, 
materials,  and  supplies  as  have 
been  mined  or  produced  in  the 
United  States,  and  only  such 
manufactured  articles,  materials, 
and  supplies  as  have  been  manu¬ 
factured  in  the  United  States  sub¬ 
stantially  all  from  articles,  mate¬ 
rials,  or  supplies  mined,  pro¬ 
duced,  or  manufactured,  as  the 
case  may  be,  in  the  United  States, 
shall  be  acquired  for  public  use. 
This  section  shall  not  apply  with 
respect  to,,, for  use  outside  the 
United  States,  or  if,,, are  not 
mined,  produced,  or  manufac¬ 
tured,.. in  the  United  States  in  suf¬ 
ficient  and  reasonably  available 
commercial  quantities  and  of  a 
satisfactory  quality.  This  section 
shall  not  apply  to  ...under  any 
contract... less  than  or  equal  to 
the  micro-purchase  threshold. . . 


This  excerpt  is  the  original  1933  Act, 
modified  twice  since  its  inception.  In 
1988,  the  phrase  “federal  agency”  replaced 
the  phrase  “department  or  independent 
establishment.”  The  second  modification 
came  as  a  result  of  the  Federal  Acquisi¬ 
tion  Streamlining  Act  (FAS A)  of  1994, 
which  inserted  the  last  provision  regard¬ 
ing  the  exemption  of  the  Act  from  apply¬ 
ing  to  micro-purchases  (purchases  that  are 
$2500  or  less).  The  Act  continues  with  a 
series  of  clarifications  and  exemptions, 
detailed  below. 


lOb-1.  Prohibition  on  procurement 
contracts;  exemptions.  This  section  adds 
the  requirement  that  federal  agencies  not 
award  contracts  for  articles,  materials,  or 
supplies  mined,  produced,  or  manufac¬ 
tured  in  a  foreign  country  whose  govern¬ 
ment  maintains,  in  government  procure¬ 
ments,  a  significant  and  persistent  pattern 
of  discrimination  against  U.S.  products  or 
services.  However,  the  President  or  head 
of  a  federal  agency  can  authorize  a  con¬ 
tract  award  if  they  determine  such  action 
is  necessary  and  Congress  is  notified.  In 
the  case  of  the  Department  of  Defense 
(DoD)  and  contracts  subject  to  memoran¬ 
dums  of  agreement  (MoAs)  with  a  foreign 
country,  only  the  President  or  his  delegate 
(the  Secretary  of  Defense  or  service 
secretaries)  can  make  the  determination 
of  necessity.  This  section  also  describes 
what  constitutes  foreign  control  of  a 
contractor. 

lOb-2.  Limitation  on  authority  to 
waive  Buy  American  Act  requirement. 

This  section  allows  the  Secretary  of  De¬ 
fense  to  rescind  blanket  waiver  of  the  Buy 
American  Act  if  a  foreign  country 
discriminates  against  U.S.  defense  prod¬ 
ucts  covered  under  existing  reciprocal 
agreements. 

lOd.  Clarification  of  Congressional 
intent  regarding  sections  10a  and 
lOb(a).  This  section  clarifies  (and  repeats) 
the  requirement  to  purchase  American 
made  goods  and  materials  “in  sufficient 
and  reasonably  available  commercial 
quantities  and  of  a  satisfactory  quality” 
unless  the  head  of  a  federal  agency  deter¬ 
mines  that  it  is  not  in  the  public  interest 
or  the  cost  is  unreasonable. 

The  annotated  version  of  Section  10 
concludes  with  an  excerpt  from  Executive 
Order  No.  10582  (1954).  This  order  defines 
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materials  as  “of  foreign  origin’  if  the  cost 
of  the  foreign  products  used  in  such 
materials  constitutes  50  percent  or  more 
of  the  cost  of  all  products  used  in  the 
materials. 

This  order  also  quantifies  the  term 
“unreasonable  costs”  as  a  domestic  bid  or 
offered  price  that  exceeds  the  bid  or 
offered  price  of  materials  of  foreign  origin 
by  a  set  price  differential.  This  differen¬ 
tial  is  6  percent  when  the  foreign  bid 
includes  applicable  U.S.  duty  and  costs 
incurred  after  arrival  in  the  United  States, 
or  10  percent  if  applicable  duty  and  all 
costs  incurred  after  arrival  in  the  United 
States  are  excluded  from  the  offered  price. 

The  Act  as  a  Protectionist  Poiicy  Tool 

Arguably,  the  Act  remains  a  Depres¬ 
sion-era  reminder  of  the  protectionist 
policies  of  the  United  States  prior  to  World 
War  II  and  has  had  a  deleterious  effect  on 
the  DoD’s  ability  to  forge  multilateral 
development  projects.  The  Act  was  cited 
under  several  challenges  against  federal 
procurement  decisions  in  the  1980s.  These 
challenges  coincided  with  the  recession  of 
the  mid-eighties,  the  rise  of  an  anti- 
Japanese  import  sentiment,  and  several 
rhetorical  calls  for  protectionism  in  the 
media  and  Congress. 

European  members  of  the  North 
Atlantic  Treaty  Organization  (NATO)  were 
particularly  vocal  in  1982  when  the 
Reagan  administration  failed  to  oppose 
amendments  to  the  defense  appropriation 
bill,  which  eliminated  waiving  of  Buy 
American  legislation  for  NATO  military 
programs  while  still  maintaining  prefer¬ 
ences  for  Canadian  products  (“Buy 
American  Actions  Concern  Allies,”  1982). 


In  1982,  a  bill  circulated  in  the  House 
of  Representatives  to  require  auto  makers 
that  sell  in  the  United  States  to  use  mini¬ 
mum  percentages  of  American  parts. 
Although  defeated,  the  bill  attempted  to 
halt  a  trend  of  American  auto  makers 
buying  parts  abroad  and  force  foreign  car 
companies  to  build  more  plants  in  the 
United  States  or  cut  their  exports  to  the 
United  States.  By  1986,  cars  sold  here 
would  have  to  contain  up  to  90  percent 
domestic  content  (Malone,  1982). 

In  1984,  the  anthracite  coal  industry, 
supported  by  Rep.  Joseph  M.  McDade  of 
Pennsylvania,  was  responsible  for  legis¬ 
lation  that  forced  the  Pentagon  to  buy 
American  coal  to  heat  U.S.  military  bases 
in  Europe,  costing  the  federal  government 
about  $15  million  a  year.  The  chief  lob¬ 
byist,  Michael  Clark,  was  honest  regarding 
his  intentions  (Isikoff,  1984): 

“It’s  a  support  for  the  industry,  for 
sure,”  said  Clark,  another  native 
of  Pennsylvania’s  anthracite 
region.  But  he  added  that  here  are 
many  other  so-called  Buy  Ameri¬ 
can  provisions  passed  by  the  Con¬ 
gress  that,  in  terms  of  cost  to  the 
government,  “make  us  seem  like 
a  little  squeak  in  the  night,  if  you 
know  what  I  mean.”  “I  don’t  like 
being  pictured  as  the  only  U.S. 
industry  being  protected  by 
legislation.” 

This  invocation  of  Buy  American  is  par¬ 
ticularly  interesting,  since  the  law  itself 
states  that  the  provisions  do  not  apply  to 
material  meant  for  overseas  consumption. 

The  National  Council  for  Industrial 
Defense  filed  suit  in  1988  alleging  that 
“the  Pentagon  routinely  violates  the  Buy 
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American  Act  and  other  federal  regula¬ 
tions  that  require  the  military  to  make  a 
concerted  effort  to  purchase  U.S.-made 
goods  and  services”  (Pullen,  1988). 

In  1987  and  1988,  the  bearing  industry 
was  singled  out  for  protection  from  for¬ 
eign  competition  when  a  Pentagon  work¬ 
ing  group  recommended  that  DoD  and  its 
contractors  initiate  Buy  American  regula¬ 
tions  for  all  de- 


^Given  the  strength  bearings 

off  the  American  purchases  for  at 

economy  during  least  three  years 


this  period,  it 
seems  saffe  to  con- 
ciude  that  the  Buy 
American  Act  is 
invoked  by  industry 
when  protectionist 
ffeeiings  run  high 
and  the  economy 
is  weak/' 


(Sfiligoj,  1987). 
Unfortunately, 
the  industry  ob¬ 
jected  that  the 
proposed  rec¬ 
ommendations 
still  provided 
only  limited 
gains  in  their 
battle  against 


imports  (Fusaro,  1988). 


Curiously,  there  have  been  few  refer¬ 


ences  in  the  literature  in  the  1990s.  Given 


the  strength  of  the  American  economy  dur¬ 
ing  this  period,  it  seems  safe  to  conclude 
that  the  Buy  American  Act  is  invoked  by 
industry  when  protectionist  feelings  run 
high  and  the  economy  is  weak. 


The  Buy  American  Act 
AND  Acquisition  Reform 


As  the  acquisition  reforms  became 
invigorated  by  the  Secretary  of  Defense 
in  1993,  several  aspects  of  “business  as 
usual”  came  under  question.  These 
included  over-reliance  on  complicated 
military  specifications,  government- 
industry  mistrust,  and  the  more  egregious 


aspects  of  the  FARs.  One  positive  outcome 
of  this  reform  was  the  FAS  A  of  1994, 
mentioned  earlier.  FAS  A  legislation  grew 
out  of  a  panel  study,  known  as  the  Sec¬ 
tion  800  panel,  to  recommend  changes  to 
the  acquisition  system  and  recommend 
any  legislative  changes.  Regarding  the 
Buy  American  Act,  they  said: 

The  Panel  recommends  that  the 
rule  of  origin  for  Buy  American 
purposes  be  amended  from  a  “50 
percent  components  test”  to  a  test 
of  “substantial  transformation” 
and  that  Congressionally  imposed 
domestic  source  restrictions  be 
repealed. 

Their  reasoning  was  cogent  (Pilot 
Program,  1998): 

Commercial  sellers  should  be 
able  to  utilize  their  established 
facilities,  technology,  supplier 
networks,  processes,  employees 
and  other  standard  commercial 
practices  in  performing  Govern¬ 
ment  contracts.  The  reality  that 
global  markets  exist  and  that 
global  markets  can  be  responsive 
to  mobilization  needs  must  be 
recognized.  Waiver  is  not  always 
possible  under  current  regula¬ 
tions.  It  is  to  our  strategic  and 
economic  advantage  to  maintain 
vital  foreign  sources  during 
peacetime  as  well  as  domestic 
sources  or  at  least  have  the  option 
to  do  so  when  market  conditions 
and  the  international  situation  so 
dictates. 
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Just  prior  to  the  final  FASA  legislation 
passage  in  1994,  there  was  still  doubt  that 
the  Buy  American  Act  would  be  repealed 
in  the  final  bill.  In  an  article  in  Govern¬ 
ment  Executive  (Gregory,  April  1994),  the 
Act  was  targeted  as  a  future  area  for 
reform: 


nothing  for  industry,  he  argues. 
“Acquisition  reform?  Clearly  it  is 
not,”  he  says.  Rather,  its  passage 
would  allow  the  administration 
and  Congress  to  check  off  the 
action-completed  box,  whether  or 
not  reform  was  real. 


Both  DoD  and  industry  groups 
also  want  authority  for  waivers 
from  the  Buy  American  Act,  a 
statute  that’s  increasingly  difficult 
to  implement  given  the  multina¬ 
tional  origins  of  many  complex 
products.  But  [Colleen]  Preston 
[Deputy  Under  Secretary  for 
Acquisition  Reform]  predicts  that 
Congress  won’t  approve  such 
waivers  in  this  year’s  legisla¬ 
tion..  .Preston  says  DoD  may  yet 
seek  relief  from  the  socioeco¬ 
nomic  requirements.  “Our  going- 
in  premise,”  she  says,  “is  that  we 
don’t  know  what  specific  law  it 
is  that  breaks  the  camel’s  back  or 
inhibits  a  company  from  doing 
business  with  the  government.” 


Ultimately,  FASA  failed  to  implement 
all  the  Section  800  panel’s  recommenda¬ 
tions  with  respect  to  the  Buy  American 
Act,  but  did  modify  the  Act  to  allow 
micropurchases  to  be  excluded  as  men¬ 
tioned  earlier.  Still,  some  industry  officials 
were  cynical  about  the  scope  of  acquisi¬ 
tion  reform  and  the  impact  of  FASA 
(Gregory,  June  1994). 


Government  acquisition  manag¬ 
ers  get  some  streamlining,  con¬ 
cedes  Peter  C.  Scrivner  of  the 
American  Defense  Preparedness 
Association,  but  the  reforms  do 


Regardless  of  initial  cynicism,  FASA 
has  provided  a  starting  point  for  acquisi¬ 
tion  reform.  Unfortunately,  the  momen¬ 
tum  of  legislative  activity  has  cooled  and 
there  appears  to  be  no  legislative  follow- 
on  to  FASA  to  address  future  acquisition 
reform.  Five  years  after  FASA,  the  Buy 
American  Act  still  remains  a  prime  can¬ 
didate  for  future  legislative  action  to 
streamline  acquisition  even  further. 

liMiTS  ON  Actions  for 
Defense  Managers 


The  immediate  impact  of  the  Buy 
American  Act  on  defense  managers,  both 
industry  and  government,  is  to  determine 
whether  a  proposed  acquisition  is  in  com¬ 
pliance  with  the  provisions  of  the  Act. 
Since  certifica¬ 
tion  of  compli- 
ance  with  the  "Regardless  of 

Act  is  a  Stan 

dard  certifica-  has  provided 

.  ^  :  « Starting  point  for 

tion  in  Section  reform." 

K  of  the  uni¬ 
form  contract 
format  (FAR, 

1998,  Part  14),  it  is  imperative  to  under¬ 
stand  the  implications  of  the  Act.  Penal¬ 
ties  for  contractors  who  violate  the  provi¬ 
sions  of  the  Act  can  include  debarment 
from  bidding  on  contracts  (FAR,  1998, 
Part  9;  DFARs,  1998,  Part  209).  The 
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impact  on  government  program  managers 
can  include  the  necessity  to  issue  stop- 
work  orders  on  contested  contracts  while 
contractor  protests  are  adjudicated. 

Implementation  in 

THEfARS  AND  DfARS _ 

The  Buy  American  Act  is  implemented 
in  FAR  Part  25  (Foreign  Acquisition).  Part 
25  also  includes  implementation  of  the 
Balance  of  Payments  Program  (specifi¬ 
cally  for  acquisitions  for  use  outside  the 

United  States), 
purchases  under 
the  Trade  Agree- 
'The  implemenia-  merits  Act  of 

lien  off  the  Buy  1979^  and  other 

American  Act  in  . 

the  DFARS  .ppenrs  ^7 

le  be  much  mere  lations  that  per- 

resfrictivefhnn  tain  to  acquir- 

either  lille  41  ing  foreign  sup¬ 
er  Ihe  FAR  25."  plies,  services, 

and  construc¬ 
tion  material. 
FAR  Part  25.4 
describes  the  various  trade  agreements  in 
effect  that  have  bearing  on  Buy  American 
and  the  Balance  of  Payments  Program. 
These  are  the  Trade  Agreements  Act  of 
1979  as  amended  by  the  Uruguay  Round 
Agreements  Act  (1994),  and  other  trade 
agreements  including: 

•  countries  designated  under  the  Carib¬ 
bean  Basin  Economic  Recovery  Act; 

•  the  United  States-Israel  Free  Trade 
Area  Implementation  Act  of  1985; 

•  the  North  American  Free  Trade 
Agreement  Implementation  Act;  and 


•  the  Agreement  on  Civil  Aircraft. 

All  of  these  have  the  effect  of  exempt¬ 
ing  a  large  number  of  countries  (includ¬ 
ing  the  European  Union)  from  the  effects 
of  Buy  American.  FAR  Part  25.402  lays 
out  the  exemption  (emphasis  added): 

The  current  threshold  is  $190,000 
for  supply  and  services  contracts 
and  $7,311,000  for  construction 
contracts. .  .When  the  value  of  the 
proposed  acquisition  of  an 
eligible  product  is  estimated  to  be 
at  or  over  the  dollar  threshold, 
agencies  shall  evaluate  offers  for 
an  eligible  product  without  regard 
to  the  restrictions  of  the  Buy 
American  Act  (see  Subpart  25.1^ 
or  the  Balance  of  Payments 
Program  (see  Subpart  25.3). 

FAR  Part  25.403  also  allows  exemp¬ 
tions  for  “Purchases  of  arms,  ammunition 
or  war  materials,  or  purchases  indispens¬ 
able  for  national  security  or  for  national 
defense  purposes,  by  the  Department  of 
Defense,  as  provided  in  departmental  regu¬ 
lations.”  This  implements  the  Title  41, 
Section  lOb-1  (c)  authority  of  the  Presi¬ 
dent  or  federal  agency  head  to  authorize 
contracts  that  would  otherwise  be 
restricted  under  the  Act. 

The  implementation  of  the  Buy  Ameri¬ 
can  Act  in  the  DFARs  appears  to  be  much 
more  restrictive  than  either  Title  41  or  the 
FAR  25.  The  “unreasonable  price”  differ¬ 
ential  of  6  percent  that  appears  in  Execu¬ 
tive  Order  10582  and  FAR  25.105  jumps 
to  50  percent  in  DFAR  225.105.  There 
appears  to  be  no  basis  in  statute  or  FAR 
for  this  large  jump  and  its  existence 
severely  inhibits  a  program  manager’s 
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ability  to  choose  from  a  globally  competi¬ 
tive  market  for  defense  goods.  However, 
there  are  waivers  in  the  DFARs  for  the 
Buy  American  Act  in  the  interests  of 
national  defense.  DFAR  225.872-1  lays 
out  these  exemptions  (emphasis  added): 


submit  a  Justification  and  Approval.  Since 
this  must  go  to  the  Head  of  Agency  for 
any  procurements  of  more  than  $2  mil¬ 
lion,  this  is  a  potential  source  of  delay  for 
awarding  contracts  to  foreign  sources. 


As  a  result  of  memoranda  of 
understanding  and  other  interna¬ 
tional  agreements,  the  DoD  has 
determined  it  inconsistent  with 
the  public  interest  to  apply  restric¬ 
tions  of  the  Buy  American  Act! 
Balance  of  Payments  Program  to 
the  acquisition  of  defense  equip¬ 
ment  which  is  mined,  produced, 
or  manufactured  in  any  of  the 
following  countries  (referred  to 
in  this  part  as  “qualifying 
countries”) 

•  Australia,  Belgium,  Canada, 
Denmark,  Egypt,  Federal 
Republic  of  Germany,  France, 
Greece,  Israel,  Italy,  Luxem¬ 
bourg,  Netherlands,  Norway, 
Portugal,  Spain,  Turkey, 
United  Kingdom. 

Individual  acquisitions  for  prod¬ 
ucts  of  the  following  qualifying 
countries  may,  on  a  purchase-by- 
purchase  basis,  be  exempted  from 
application  of  the  Buy  American 
Act  and  Balance  of  Payments 
Program  as  inconsistent  with  the 
public  interest 

•  Austria,  Finland,  Sweden, 
Switzerland. 

If  a  waiver  is  contemplated,  DFAR 
225.872-4  lays  out  the  requirement  to 


Consequences  of  Failures 
TO  Consider  the  Aa 


The  failure  to  consider  the  Buy  Ameri¬ 
can  Act  may  be  grounds  for  protest  of  a 
contract  award  to  a  foreign  source  by  do¬ 
mestic  sources  that  are  unsuccessful.  For¬ 
tunately,  protests  of  contract  awards  that 
cite  the  Act  have  been  denied  when  there 
is  clear  evidence  that  the  acquisition  was 
within  the  bounds  of  the  FARs  and 
DFARs.  In  one  case,  a  U.S.  firm,  Fire- 
Tec,  protested 
the  award  of  a 
contract  for  15  "The  failure  to 

fire-fighting  censider  the  Buy 

trucks  to  any  American  Act  may 
foreign  firm,  al-  '»®  9h»«"«Is 
leging  that  for-  a  contract 

.  ^  ,  award  to  a  foreign 

eign  firms  have  L  j  -T* 

^  ..  source  by  domestic 

a  competitive  that  are 

advantage  over  |;(pi„successf ul." 
domestic  firms 
because  they  are 

not  subject  to  laws  and  regulations  with 
which  domestic  firms  must  comply.  The 
protest  was  denied,  with  the  following 
rationale  (Defense  Acquisition  University, 
1996): 


In  denying  the  protest,  we  pointed 
out  that  the  possession  of  some 
economic  advantage  such  as  the 
inapplicability  of  minimum  wage 
standards  provides  no  basis  for 
rejecting  a  foreign  bid.  Reflected 
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in  our  decision  was  the  fact  that 
there  is  no  federal  law  which 
seeks  to  equalize  the  “competitive 
advantage”  which  a  foreign  firm 
may  possess,  other  than  the  Buy 
American  Act,  41  U.S.C.  lOa-d 
(1976).  If,  after  the  requirements 
of  the  Buy  American  Act  have 
been  satisfied,  the  foreign  bidder 
remains  low,  is  found  to  be 
responsible,  and  its  bid  is  respon¬ 
sive,  then  there  is  no  further 
barrier  to  an  award  to  that  firm. 


Even  though  a  contract  award  may  not 
have  been  protested,  the  Act  can  still  have 
an  impact  when  there  are  egregious 
examples  of  a  contracting  agency’s  fail¬ 
ure  to  consider  its  application.  When  Rep. 
James  Traficant  of  Ohio  discovered  that 
Chinese-made  boots  were  purchased  by 
the  Air  Force  Reserve  Facility  in  Vienna, 
OH,  the  Defense  Logistics  Agency 
(DLA)  and  the  Air  Force  conducted  an 
extensive  investigation.  DLA  and  the  Air 

Force  found 
that  Chinese- 
made  boots 
were,  in  fact, 
purchased  and 
issued  to  U.S. 
military  person¬ 
nel,  and  that  the 
Buy  American 
Act  was  vio¬ 
lated  (http:// 
www.house.gov/traficant/junel9.htm, 
1997).  This  prompted  an  amendment  to 
the  fiscal  year  1998  Defense  Authoriza¬ 
tion  Bill,  directing  the  Inspector  General 
of  the  Department  of  Defense  to  conduct 
a  random  audit  of  U.S.  military  installa¬ 
tions  to  determine  the  extent  to  which  base 


Buy  Americon 
Act  and  its  subse¬ 
quent  modifications 
represent  one  of 
the  most  visible 
and  egregious 
remnants  of  U.S. 
protectionism/' 


funds  are  being  used  to  purchase  foreign- 
made  goods.  Thus,  the  Act  still  provides 
a  political  mechanism  to  question  DoD 
acquisition  of  foreign  goods  and  remains 
a  fixture  in  acquisition  management,  for 
better  or  worse. 


CONCIUSIONS 


The  Buy  American  Act  and  its  subse¬ 
quent  modifications  represent  one  of  the 
most  visible  and  egregious  remnants  of 
U.S.  protectionism.  Its  very  existence 
refutes  the  U.S.  desire  to  only  “level  the 
playing  field”  in  international  trade.  It  has 
been  used  in  the  past  to  justify  congres¬ 
sional  protection  of  specific  industries 
with  an  associated  burden  to  DoD.  It  has 
been  cited  as  a  justification  for  other 
countries  to  institute  their  own  domestic 
content  requirements. 

The  Act  is  implemented  haphazardly  in 
the  acquisition  regulations,  where  the 
FARs  declare  that  domestic  product  prices 
are  “unreasonable”  if  they  exceed  foreign 
product  prices  by  more  than  6  percent, 
while  the  DFARs  use  a  50  percent  price 
differential.  Acquisition  reform  groups 
have  targeted  its  existence  for  repeal,  but 
efforts  to  date  have  failed. 

The  irony  is  that  the  Act  is  largely 
ineffective  in  providing  preferences  for 
U.S.  domestic  content.  The  Act  has 
numerous  loopholes  and  waiver  authority 
provisions  to  allow  foreign  goods  to 
compete  with  U.S.  goods  on  a  reasonably 
competitive  basis.  In  addition,  U.S. 
defense  industries  have  become  very 
efficient  and  compete  successfully  with 
foreign  firms  on  price  and  performance 
of  military  goods.  Therefore,  the  Buy 
American  Act  should  make  defense 
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managers  wary,  but  not  discouraged,  when  arrangements  with  foreign  sources  to 
pursuing  foreign-made  goods  or  teaming  fulfill  U.S.  military  requirements. 


Lieutenant  Colonel  Joseph  Smyth  earned  his  Bachelor  Degree  in  Electrical 
Engineering  from  Tulane  University  in  1980.  As  a  1981  Distinguished  AFIT  Gradu¬ 
ate,  he  received  a  Masters  Degree  in  Electrical  Engineering.  He  graduated  from 
Flight  Test  Engineering  at  the  USAF  Test  Pilot  School  in  1986,  and  the  Air  Com¬ 
mand  and  Staff  College  in  Montgomery,  AL,  in  1995.  As  a  Guidance  and  Control 
System  Engineer  at  the  Armament  Division,  Eglin  AFB,  FL  in  1 982,  he  performed 
extensive  weapon  simulations  and  analyses  of  all  major  weapon  systems  under 
development,  including  AMRAAM  and  GBU-24  LLLGB.  In  1986  he  became  Flight 
Test  Engineer,  then  Chief  Engineer  for  the  F-117  Stealth  Fighter,  performing 
weapons,  avionics,  aircraft  performance  and  flying  qualities  testing,  as  well  as 
testing  the  laser-guided  GBU-27  on  the  F-1 1 7.  In  1 991 ,  as  Assistant  Deputy  for 
Engineering  for  Joint  STARS  Joint  Test  Force  in  Melbourne,  FL,  he  integrated  it 
into  theater-level  exercises  (Operations  CROSSBOLT  and  DESERT  CAPTURE), 
demonstrating  real-time  data  fusion,  location  and  targeting.  He  developed  the 
first  operational  evaluation  of  Joint  STARS  while  in  developmental  test,  which 
was  subsequently  adopted  by  AFOTEC  for  developing  operational  test  plans. 
As  Deputy  for  Engineering,  he  led  the  flight  test  planning  and  execution  of  the 
production  E-8C  aircraft.  In  1995  as  Combined  Test  IPT  lead  of  the  Joint  Ad¬ 
vanced  Strike  Technology  Program  (Joint  Strike  Fighter),  he  set  up  the  first  Com¬ 
bined  Test  Working  Group,  incorporated  operational  test  and  live  fire  test  activi¬ 
ties  into  the  JSF  Program,  and  authored  the  test  portion  of  the  Single  Acquisition 
Management  Plan  that  supported  a  Milestone  I  decision.  In  1996  as  Chief  Engi¬ 
neer  for  the  Boeing  X-32  prototype  aircraft,  he  was  responsible  for  all  technical 
aspects  of  the  development  of  one  of  the  two  competing  prototypes  for  JSF,  and 
he  conducted  both  the  Initial  Design  Review  and  the  Final  Design  Review.  In 
July  1998  he  reported  to  ICAF  as  a  student.  His  next  assignment  is  Deputy  Divi¬ 
sion  Chief,  Airborne,  C2  and  Radar  Systems,  SAF/AQID. 
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TUTORIAL 


lOGISTIG  TEST 
AND  EVAIUATION: 
AH  OVSRVim 

Tony  Parker 


Subtle  flaws  in  design  can  have  multimillion-dollar  effects — and  sometimes 
potentially  catastrophic  ones.  A  vigorous  logistics  test  and  evaluation  process 
is  essential  to  ferret  out  these  potential  problems,  and  make  sure  that  when 
fielded  a  system  is  supportable,  maintainable,  safe,  survivable,  and 
transportable.  An  Office  of  the  Secretary  of  Defense  (OSD)  study  suggests 
that  this  is  a  job  we  need  to  do  better;  here  is  a  guide  on  how  to  go  about  it, 
illustrated  with  specific  cases  that  show  its  value. 


Logistics  is  a  primary  element  in  a  thor¬ 
ough  test  and  evaluation  of  new  or 
modified  weapons  systems.  It  is  criti¬ 
cal  to  the  warfighter  that  we  provide  an 
early  assessment  of  the  overall  support  char¬ 
acteristics  of  the  system  we  are  evaluating. 

In  our  evaluations  of  the  system  under 
test  (SUT),  we  need  to  remain  focused  on 
the  goal  of  providing  a  system  that  maxi¬ 
mizes  its  operational  availability  (A^) 
within  the  life-cycle  cost  (LCC)  of  the 
program.  The  system  must  minimize  the 
amount  of  time  that  maintainers  expend 
getting  it  ready  to  perform  its  mission, 
recovering  the  system  after  the  mission, 
and  returning  it  to  a  mission-ready  status 
again.  That  is,  we  must  build  systems  that 
maximize  their  A^s  or  we  build  a  ground 
target  for  the  enemy. 


A  key  principle  of  logistics  test  and 
evaluation  (LT&E)  is  to  ensure  that  the 
system  under  development  is  able  to 
achieve  the  readiness  objectives  for  both 
peacetime  and  wartime  scenarios.  This  is 
accomplished  through  a  unified  and  itera¬ 
tive  approach  to  the  management  and  tech¬ 
nical  activities  that  allow  support  consid¬ 
erations  to  influence  system  requirements 
and  the  design  process.  The  support 
requirements  and  the  design  must  be 
optimally  related  to  each  other  in  order  to 
maximize  the  system  A^  throughout  its  life 
cycle.  During  the  LT&E  process,  we  sys¬ 
tematically  evaluate  each  of  the  logistic 
support  elements  and  their  interrelation¬ 
ship  with  other  elements.  Part  of  this  pro¬ 
cess  is  to  identify  system  deficiencies, 
provide  enhancement  options,  and  then 
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evaluate  corrections  made  to  the  system. 
This  continuous  process  will  help  to  en¬ 
sure  the  system  maximizes  its  when  it 
is  fielded. 

So  what  drove  us  to  reexamine  the 
method  we  used  to  evaluate  the  SUT?  One 
impetus  was  the  OSD  study  that  suggested 
the  Services  were  not  systematically 
evaluating  the  SUT  as  well  as  could  be 
done.  While  we  may  have  thought  we  were 
doing  a  good  job  of  putting  systems  out 
in  the  field  that  were  reliable  and  main¬ 
tainable  and  able  to  achieve  their  A^,  the 
feedback  from  the  field  was  that  we  could 
do  much  better. 

Reliability  and  maintainability  are  what 
really  determine  A^.  Recall  the  definition 

of  A^: 

0 

MTBM 

Ao- - 

MTBWl  +  MDT 

where  MTBM  equals  the  mean  time  be¬ 
tween  maintenance,  and  MDT  equals  the 
maintenance  delay  time.  The  formula  is 
based  on  the  assumption  that  the  system 

is  designed  with 

"Reliability  and  Rf ' 

maintainability,  the 

along  with  perfer-  probability  that 

mance,  should  act  will 

as  equal  partners  perform  a  re¬ 
in  the  require-  quired  function 

ments  generation  under  specified 

process."  conditions  for  a 

specified  pe¬ 
riod  of  time,  or  at  a  given  point  in  time. 
Maintainability  is  the  probability  that  an 
item  will  be  retained  in,  or  restored  to,  a 
specified  condition  within  a  given  period 
of  time.  Reliability  and  maintainability, 
along  with  performance,  should  act  as 


equal  partners  in  the  requirements  genera¬ 
tion  process. 

Life-cycle  Costs 


In  a  typical  acquisition  program,  the 
system  program  office  (SPO)  has  commit¬ 
ted  more  than  80  percent  of  the  LCC 
before  the  engineering  and  manufacturing 
development  test  program  has  begun.  The 
program  hasn’t  written  the  check,  but  they 
have  made  key  decisions  on  the  design  of 
the  system  and  the  support  characteristics 
that  essentially  commit  those  funds.  Based 
on  design  and  its  reliability  and  maintain¬ 
ability  predictions,  the  SPO  will  determine 
of  the  number  of  spares  of  each  particular 
type  that  will  be  purchased,  what  support 
equipment  will  be  used,  and  whether  new 
equipment  will  be  procured.  These  pre¬ 
dictions  are  also  used  to  determine  the 
types  of  skills  needed  and  the  varying  skill 
levels  required,  and  other  manpower  con¬ 
siderations.  During  LT&E,  we  are  char¬ 
tered  to  validate  the  contractor’s  estimates 
and  provide  that  data  to  the  program  office. 
Under-  or  over-estimating  the  reliability 
and  maintainability  of  the  component 
pieces  of  the  system  will  cause  already 
limited  dollars  to  be  allocated  unwisely. 
Accomplishing  LT&E  early  and  continu¬ 
ously  throughout  the  development,  test, 
and  evaluation  (DT&E)  program  allows 
SPO  personnel  to  determine  what  needs 
to  be  adjusted  and  by  how  much,  to 
provide  the  required  system  support 
throughout  the  program’s  life  cycle. 

Most  of  the  LCC  of  a  system  is  spent 
during  the  operations  and  support  (O&S) 
phase.  Typically  10  percent  of  the  pro¬ 
gram’s  LCC  is  spent  during  the  research, 
development,  test,  and  evaluation  (RDT&E) 
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phase  of  the  program.  While  we  may  view 
production  as  the  most  costly  portion  of 
the  program  per  unit  of  time,  it  really  only 
amounts  to  some  30  percent  of  the  LCC. 
Based  on  these  figures,  it  becomes  readily 
apparent  that  the  largest  cost  driver  in  the 
life  of  a  system  is  the  O&S  phase.  With  a 
system  such  as  the  B-52  bomber,  which 
is  doubling  (or  more)  its  life  expectancy, 
it  is  easy  to  see  that  O&S  costs  will  form 
75-90  percent  of  its  LCC.  Essentially,  it 
costs  almost  twice  as  much  to  maintain 
and  support  a  system  once  it  has  been 
fielded  as  it  does  to  acquire  and  produce 
that  same  system.  For  a  major  system  such 
as  the  B-2,  which  costs  $44  billion  in 
RDT&E  and  production,  the  Air  Force  can 
expect  to  spend  about  $66  billion  more  in 
the  O&S  portion  of  that  aircraft’s  life 
cycle. 


The  B-i 


ion:  An  Overview 


Coordinating  the  H&E  Process 

The  LT&E  of  today  is  a  significantly 
different  process.  Previously  we  used 
maintainability  demonstrations,  support 
equipment  compatibility  demonstrations, 
and  technical  order  verifications,  but  all 
were  conducted  independently.  The  cur¬ 
rent  LT&E  discipline  makes  a  synergistic 
application  of  all  the  logistics  support 
elements.  The  goal  of  LT&E  is  to  test, 
evaluate,  analyze  the  system,  and  then 
report  those  findings  to  the  customer. 
Established  guidance  exists  that  addresses 
the  need  to  accomplish  LT&E.  (In  fact, 
when  Air  Force  Instruction  [AFI]  99-101 
was  being  drafted,  we  were  asked  to 
develop  the  wording  for  LT&E.) 

Now  that  we  have  guidance,  what  do 
we  use  for  test  and  evaluation  criteria? 
What  will  define  satisfactory  systems 


Bomber 
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performance?  The  place  to  start  is  the 
operational  requirements  document 
(ORD).  What  are  the  requirements  the  user 
has  given  us  for  the  system?  How  have 
those  requirements  been  translated  into 
the  system  specification?  For  example, 
what  are  the  mean  time  between  failure 
(MTBF)  and  mean  time  to  repair  (MTTR) 
requirements? 

Human  factor  requirements  come  from 
both  the  ORD  and  the  system  specifica¬ 
tion.  For  example,  will  we  be  able  to 
complete  all  maintenance  tasks  while  in 
chem  gear,  or  even  cold  weather  gear?  Is 
equipment  being  designed  for  ease  of  ac¬ 
cessibility  and  maintenance?  Are  line-re¬ 
placeable  units  (LRUs)  being  designed  and 
installed  in  such  a  way  that  one  person 
can  accomplish  the  task  if  required? 

Supportability  analysis  predictions  are 
a  critical  part  of  how  we  evaluate  the  sys¬ 
tem.  If  the  LRU  has  been  designed  to  work 
for  350  hours  before  it  fails,  then  that  is 
the  criteria  used  to  evaluate  its  success  or 
failure.  If  it  fails  continually  at  100  hours, 


the  customer  needs  to  know,  in  order  to 
reevaluate  system  design.  If  spare  LRUs 
were  purchased  based  on  a  350-hour 
MTBF,  there  would  now  be  an  insufficient 
quantity  of  spares. 

We  need  to  ensure  that,  although  we 
test  each  part  of  the  system,  we  are  able 
to  evaluate  the  overall  system  supportabil¬ 
ity,  maintainability,  safety,  survivability, 
and  transportability.  You  can  almost 
directly  translate  these  requirements  into 
the  logistic  support  elements  (LSEs). 

When  comparing  the  test  data  with  the 
LSE  predictions,  be  aware  that  a  new 
design  or  new  use  of  an  LRU  may  suffer 
infant  mortality  or  have  initially  low  reli¬ 
ability.  Test  the  system  long  enough  to  dis¬ 
tinguish  between  development  pains  and 
fundamental  problems  (i.e.,  the  unit  not 
working  as  it  should  and  the  data  telling 
you  it’s  not  getting  any  better).  Report 
these  problems  to  the  customer  and  also 
provide  them  with  recommended  changes 
to  improve  the  shop  replaceable  unit 
(SRU)/LRU,  or  system.  Technical  Order 
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00-35D-54  provides  not  only  a  means  to 
report  system,  LRU,  and  SRU  deficien¬ 
cies,  but  a  means  to  recommend  enhance¬ 
ments  to  the  system.  This  is  a  reason  why 
we  use  people  who  have  current  opera¬ 
tional  experience  to  perform  the  LT&E. 
They  know  what  is  happening  in  the  field 
and  know  how  to  make  the  system  better. 

Finding  Problems  Early 


The  AFI 99-101  stressed  that  the  DT&E 
communities  look  at  the  maintainability 
and  suitability  (supportability)  of  the  sys¬ 
tem  early  in  the  development  program. 
Although  at  this  point  we  may  be  assess¬ 
ing  prototypes  or  preproduction  equip¬ 
ment,  we  can  still  make  an  early  determi¬ 
nation  of  how  the  system  will  work  when 
updated,  modified,  or  changed,  based  on 
our  DT&E  findings.  Consider  the  train¬ 
ing  that  was  provided  to  the  maintenance 
team  and  make  determinations  by  their 
ability  to  maintain  the  system:  Was  the 
training  adequate?  Are  the  technical  orders 
they  are  working  with  adequate  to  accom¬ 
plish  the  tasks?  (They  may  not  be  validated 
and  verified.)  Is  the  support  equipment 
they  are  using  the  equipment  that  will  be 
fielded?  If  not,  have  they  been  able  to 
evaluate  the  proposed  support  equipment 
designs?  What  is  the  number  of  person¬ 
nel  needed  to  support  and  test  the  system 
in  the  test  environment;  will  this  number 
be  adequate  for  the  system  when  it  is 
fielded?  Do  we  have  the  correct  Air  Force 
Speciality  Codes  (AFSCs)  identified  with 
the  correct  skill  levels?  Finally,  are  the 
maintenance  procedures  correct?  Are  we 
asking  an  engine  technician  to  maintain 
an  instrument  system,  just  because  it  is 
an  engine  instrument? 


In  a  typical  program  it  is  many  years 
from  the  development  of  the  ORD  to  the 
point  at  which  a  system  is  available  for 
testing  in  the  engineering  and  manufac¬ 
turing  development  phase.  During  that 
time,  events  can  change  the  user  require¬ 
ments:  The  threat  may  change,  or  the 
program  funding  may  be  reduced  or 
increased.  The  ORD  format  will  identify 
all  of  the  LSEs 
and  will  provide  ^ 

the  author  the  >  eventually 

opportunity  to  impinge  upon  meney 

input  require-  Hint  we  we  need 
ments  into  the  le  spend  on  other 

ORD  for  testing  new  equipment 

those  elements  t  ••  upgrades." 
to  ensure  that  a  I 

supportable  system  is  fielded.  The  inser¬ 
tion  of  human  factors  and  LS  A  predictions 
is  another  way  to  evaluate  the  data  that 
we  gather  on  the  system.  These  items,  the 
10  LSEs,  the  user’s  requirements,  human 
factors,  and  the  supportability  analysis 
predictions,  when  tested  and  evaluated 
together,  provide  a  comprehensive  analy¬ 
sis  of  whether  the  system,  when  fielded, 
will  be  able  to  attain  the  required  A^. 

Other  documents  provide  additional 
information.  The  program  office  will 
develop  the  logistics  support  plan,  which 
describes  how  the  customer  and  the 
acquisition  personnel  envision  life-cycle 
support  for  the  system.  LT&E  is  the  pri¬ 
mary  method  used  to  test  the  plan  and 
determine  if  it  is  effective.  The  contractor 
will  also  have  a  plan  describing  how  the 
system  will  be  supported  from  production 
to  disposal.  This  plan  should  be  developed 
using  a  relational  data  base,  which  flags 
how  changes  in  one  element  will  affect 
others.  (For  example,  if  the  numbers  and 
skills  of  the  personnel  in  the  field  change. 
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the  data  base  will  identify  other  support 
elements  that  will  be  affected.) 

The  test  and  evaluation  master  plan 
(TEMP),  written  by  the  test  planning  work¬ 
ing  group,  is  one  of  the  primary  manage¬ 
ment  documents  for  this  phase  of  the 
program.  The  TEMP  contains  five  sections: 

•  a  system  description; 

•  an  integrated  program  schedule  with  a 
focus  on  the  test  schedule; 

•  DT&E  objectives; 

•  the  objectives  of  the  operational  testers; 
and 

•  the  test  program  resource  requirements. 

Examples  of  program  resources  are: 
number  of  personnel  required,  location  of 
testing,  duration  of  testing,  number  of  test 
articles,  number  of  spare  assets,  funding 
by  fiscal  year,  and  training.  Program 
resources  are  what  we,  the  test  community, 
need  to  complete  the  test  and  evaluation 
of  the  system. 

IT&E  Successes 


Let’s  look  for  a  moment  at  some  of  the 
results  of  accomplishing  LT&E.  During 
testing  of  a  new  F-15  crypto  key  loading 
device,  the  contractor  had  recommended 
a  new  extension  cable.  Maintenance  per¬ 
sonnel  determined  that  it  wasn’t  necessary 
to  use  the  cable  to  load  the  device.  This 
saved  $58  per  cable  and  about  $1,044.00 
per  F-15  fighter  wing  per  year.  It  doesn’t 
seem  like  much,  until  you  look  at  a  small 
cost  like  this  in  the  context  of  shrinking 


budgets.  How  many  fighter  wings  of  F- 
15s  do  we  have,  and  how  long  will  the  F- 
15  remain  in  the  inventory?  Little  costs 
mount  up,  and  eventually  impinge  upon 
money  that  we  we  need  to  spend  on  other 
new  equipment  or  upgrades. 

The  results  of  successful  LT&E  can  be 
potentially  much  more  dramatic:  In  the 
original  global  positioning  satellite  modi¬ 
fications  on  the  F-15,  the  seal  for  the  con¬ 
trolled  reception  pattern  antenna  had  metal 
washers  that  were  not  captive  in  the  seal 
and  were  prone  to  slip  off  the  seal  during 
installation  and  removal.  As  a  result  of 
input  from  the  maintainers,  the  finished 
product  eliminated  the  need  for  the  seal 
and  the  loose  hardware.  Another  modifi¬ 
cation  of  the  global  positioning  satellite 
recommended  by  maintenance  personnel 
was  the  relocation  of  the  proposed  antenna 
electronics  unit,  which  chafed  against  the 
right  rudder  pedal  cable.  The  possible  con¬ 
sequences  of  this  initial  design  flaw — loss 
of  the  aircraft  and  possibly  of  the  crew — 
demonstrate  the  value  of  this  kind  of 
assessment. 

An  example  of  what  can  happen  if  the 
maintainers  are  not  involved  early  in  the 
DT&E  process  is  demonstrated  by  the 
modified  SUU-73/A  pylon.  When  the 
pylon  was  installed  as  designed,  certain 
engine  access  panels  could  not  be  opened. 
So  every  time  access  was  required,  the  fuel 
tank  pylon  or  the  weapons  pylon  would 
have  to  be  removed — an  8-manhour  job. 
Needing  excess  time  to  repair  aircraft  is 
just  the  same  as  not  having  enough  aircraft 
to  accomplish  the  mission. 

Here’s  a  good  example  of  how  being 
involved  early  in  the  acquisition  process 
has  an  impact  on  the  design.  An  electro- 
environmental  specialist  looking  at  the 
mockup  at  the  plant  in  Long  Beach,  CA, 
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noticed  that  the  C-17  cargo  compartment 
liquid  oxygen  filler  connection  had  pro¬ 
truding  screws,  which  would  prevent  the 
filler  cart  hose  from  being  attached  prop¬ 
erly.  When  brought  to  the  attention  of  the 
manufacturer,  the  flaw  was  described  as 
merely  an  error  in  the  mockup.  Through 
persistence,  the  specialist  found  and  stud¬ 
ied  the  design  drawing,  and  determined 
that  it  was  assembled  correctly.  The  con¬ 
nector  would  not  have  been  able  to  lock, 
and  maintenance  would  have  been  unable 
to  service  the  system.  The  drawing  was 
changed  and  the  assembly  line  was 


checked  to  ensure  that  the  change  was 
incorporated. 

The  following  example  shows  how  a 
small  item  can  run  into  big  money  because 
reliability  figures  weren’t  accurately  esti¬ 
mated.  A  wingtip  lamp  for  the  C-17,  both 
front  and  rear  positions,  is  the  same  lamp 
that  is  installed  in  the  KC-10  (DC-10)  to 
illuminate  the  wing’s  leading  edge  during 
flight.  On  the  KC-10  it  is  mounted  in 
the  side  of  the  fuselage  skin  in  a  very 
benign  environment,  and  needs  to  be 
replaced  every  676  hours.  That  same  lamp 
on  the  wingtip  of  the  C-17  is  in  a  different 
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operating  environment  (higher  vibration 
and  temperatures)  and  the  lamp  only  lasts 
for  25  hours  in  the  forward  position  and 
50  hours  in  the  aft  position. 

The  lamp  did  not  come  close  to  its  pre¬ 
dicted  value,  and  if  insufficient  spares  of 
this  mission-critical  part  were  purchased, 
all  of  the  C-17s  could  soon  be  grounded 
for  want  of  a  lamp.  The  impact  of  the 
lamp’s  invalid  reliability  figure  of  676 
hours  MTBF  on  the  life-cycle  cost  of  the 
C-17  is  an  estimated  additional  $4.5  mil¬ 
lion.  With  the  actual  MTBF  numbers  in 
hand,  the  system  program  office  can  at 
least  adjust  the  procurement  requirements 
for  spares. 

Here  is  another  example  of  the  effec¬ 
tiveness  of  early  LT&E  in  identifying 
design  shortfalls.  The  original  estimate  for 
the  C-17  water  coalescer  bag  was  that  it 
would  be  changed  approximately  once  a 
year  (about  every  1,000  to  1,200  flying 


hours),  which  was  the  normal  change  rate 
for  the  current  fleet  of  airlifters  (C-130, 
C-141,  C-5).  We  determined  during  the 
test  program  that  because  of  the  design  of 
the  auxiliary  power  unit’s  intake  and 
exhaust,  and  the  proximity  to  the  air  con¬ 
ditioning  system  intake,  the  bags  (some¬ 
times  called  the  water  separator  socks) 
were  becoming  clogged  every  25  flying 
hours.  It  didn’t  take  long  for  supply  of  bags 
to  run  out.  Through  some  redesign  and 
changes  in  the  maintenance  procedures, 
the  bags  now  last  about  250  hours  (still  a 
dramatic  LCC  impact).  If  it  doesn’t  get 
fixed,  the  cost  will  be  an  estimated  $29 
million. 

Another  instance  of  the  value  of  early 
design  review  occurred  during  the  B-2  pro¬ 
gram,  when  egress  technicians  at  the 
manufacturing  facility  reviewing  the 
mockup  design  noticed  the  upper  escape 
hatch  was  secured  with  hi-torq  fasteners. 
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The  upper  hatch  has  to  be  removed  once  a 
year  for  inspection  of  the  ejection  seat.  The 
maintenance  demonstrations  showed  that 
with  the  hi-torqs  installed,  it  would  take 
two  people  214  manhours  to  remove  the 
hatch.  This  amounted  to  a  5-day  effort, 
working  around  the  clock.  The  egress  tech¬ 
nicians  wanted  to  change  the  hi-torqs  for 
screws  and  nutplates,  but  the  engineers 
were  reluctant,  asserting  that  the  hatch  was 
a  stress  panel.  The  egress  technicians 
pointed  out  that  the  F-4  aircraft  was  basi¬ 
cally  a  flying  stress  panel,  and  used  screws 
and  nutplates  predominately  throughout 
the  aircraft  to  secure  panels.  It  was  agreed 
to  evaluate  the  change  to  screws  and 
nutplates.  After  a  series  of  successful  tests 
at  the  Holloman  Air  Force  Base,  NM,  sled 
track,  it  was  agreed  to  use  screws  and 
nutplates.  The  maintenance  task  time  was 
reduced  to  18  manhours  (2  people) — ^in 
other  words,  one  normal  work  shift.  This 
seemingly  simple  change  meant  the  air¬ 
craft  increased  its  A^  dramatically.  What 
this  means  is  the  inspection  can  be  done 


overnight  and  the  aircraft  will  be  ready  to 
fly  and  fight  again  the  next  day. 

CONCIUSION 


Logistics  test  and  evaluation  is  a  major 
portion  of  the  DT&E  process.  The  goal  is 
to  field  systems  that  are  supportable  from 
the  very  beginning.  That  doesn’t  mean  that 
we  won’t  continue  to  modify  weapons 
systems.  It  means  that  the  modifications 
we  install  will  be  the  result  of  new  tech¬ 
nology,  not  something  that  we  will  con¬ 
stantly  have  to  modify  just  to  meet  the 
original  reliability  and  maintainability 
goals.  We  will  make  sure  the  user  gets 
what  they  ask  for  and  that  it  meets  the 
ORD  requirements  for  A^.  If  it  is  supposed 
to  have  a  95  percent  fully  mission  capable 
rate,  is  that  what  is  occurring  in  the  field? 
If  it  is  not  at  95  percent,  why  not?  Does 
the  radar  work  for  500  hours  before  it  fails, 
as  it  was  required  to  do?  If  not,  why  not? 
Is  the  user  spending  all  of  its  O&S  money 
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on  modifying  the  system  to  make  it  meet 
those  original  requirements,  or  are  they 
spending  it  on  the  things  necessary  to 
maintain  their  proficiency  to  be  prepared 
in  times  of  crisis? 

Ensuring  that  the  warfighter  receives 
maintainable  and  supportable  systems  is 


the  goal  of  LTc&E.  While  it  will  generally 
have  a  larger  LCC  impact  if  discovered 
during  the  DT&E  process.  LT&E  should 
continue  throughout  the  operational 
T&E  phase  and  in  fact  should  be  a  part 
of  any  modifications  that  will  effect  the 
supportability  of  the  system. 


Tony  Parker  has  been  associated  with  the  Air  Force  in  the  aircraft  maintenance 
and  logistics  career  field  since  1961.  After  retirement  from  active  duty,  he  re¬ 
turned  to  government  service  as  a  logistics  manager.  He  is  currently  employed 
at  the  Air  Force  Flight  Test  Center’s  41 2th  Logistics  Group.  He  is  a  staff  officer  in 
the  Logistics  Test  and  Evaluation  Office. 

E-mail  address:  anthony.parker@edwards.af.mil 


DISCLAIMER 

The  opinions,  interpretations,  conclusions,  and  recommendations  herein  are 
those  of  the  author  and  are  not  necessarily  endorsed  by  the  U.S.  Air  Force. 
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TUTORIAL 


VALUE  COST  MANAGEMENT 
REPORT  TO  EVALUATE 
TNE  CONTRAQOR'S  ESTIMATE 
AT  COMPLETION 

Davids,  Christensen,  Ph.D, 


The  earned  value  cost  management  report  Is  a  valuable  management  tool 
for  project  managers.  Its  long  association  with  earned  value  management 
systems  criteria  (formerly  cost/schedule  control  systems  criteria)  and  the 
related  technical  jargon,  however,  may  have  caused  some  project  managers 
to  ignore  the  information  that  it  can  provide  about  the  future  performance  of 
their  projects.  This  article  is  a  brief  tutorial  for  project  managers  and  others 
interested  in  using  the  report  more  effectively.  Actual  performance  data  from 
a  failed  project  and  important  research  results  are  used  to  describe  three 
simple  analysis  techniques  for  evaluating  the  contractor’s  projected  final  cost 
of  a  project,  termed  the  estimate  at  completion. 


For  more  than  three  decades,  the  De¬ 
partment  of  Defense  (DoD)  has  re¬ 
quired  defense  contractors  to  report 
detailed  information  about  the  cost  and 
schedule  status  of  a  defense  contract  on  a 
monthly  cost  management  report,  known 
as  the  cost  performance  report  (CPR)  or 
the  cost/schedule  status  report  (C/SSR). 
Earned  value,  or  the  budgeted  cost  of  work 
performed,  is  a  key  performance  metric 
on  the  report.^  It  is  the  basis  for  determin¬ 
ing  cost  and  schedule  variances,  and  is 
often  used  as  part  of  a  formula  to  help 
estimate  the  final  cost  of  the  contract, 
termed  the  estimate  at  completion  (EAC). 


To  assure  the  reliability  of  the  CPR, 
defense  contractors  were  also  required  to 
comply  with  generic  management  stan¬ 
dards  known  as  cost/schedule  control  sys¬ 
tems  criteria  (C/SCSC).  Although  the 
management  standards  or  criteria  were 
sound,  policies  related  to  implementing 
them  grew  to  become  an  administrative 
burden  for  the  government  and  the  con¬ 
tractor  (Coopers  and  Lybrand,  1994;  Gen¬ 
eral  Accounting  Office,  1997).  In  addition, 
C/SCSC  compliance  reviews  were  typi¬ 
cally  managed  by  financial  personnel  and 
conducted  like  audits.  As  a  result,  the 
project  manager  often  perceived  the  CPR 
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as  a  financial  rather  than  a  management 
report,  and  did  not  use  it  as  effectively  as 
possible  (Abba,  1995). 

Recently,  the  implementation  polices 
were  revised  to  foster  more  cooperation 
between  the  government  and  the  contrac¬ 
tor  and  to  establish  the  CPR  as  a  manage¬ 
ment  report.  Overall  responsibility  for 
earned  value  management  was  moved 
from  finance  to  project  management  in 
1989.  In  1996,  the  criteria  were  revised 
by  industry,  accepted  by  the  government, 
and  re-named  earned  value  management 
systems  (EVMS)  criteria. 

The  basic  concept  of  earned  value 
management  has  not  changed  since  its 
inception  since  1967.  In  addition,  the  con¬ 
tent  of  the  cost  management  report  has  not 
changed,  possibly  because  its  value  as  a 
project  management  tool  is  widely 
recognized  (Little,  1983  and  1984;  DoD 
IG  Audit  Report,  1993;  Office  of  Man¬ 
agement  and 

"The  effect  e«  Budget,  1997; 

"Theeffertef 

o  manufacturer's  .  / 

changes  to  aviation  This  article  de- 

COTS  can  bo  boiled  scribes  the  ba- 

devm  to  two  specific  sic  data  pro- 

difficulties,  airwor-  vided  in  the  re- 

thiness  and  forced  port  and  identi- 

modificationse"  fies  a  few  tech¬ 

niques  for  con¬ 
verting  the  data  into  information  useful 
to  contract  managers,  project  managers, 
and  others  involved  in  managing  a  major 
project.  In  particular,  three  ways  to 
evaluate  the  reasonableness  of  the 
contractor's  EAC  are  described.  Two  of 


these  involve  comparing  the  project’s 
cumulative  cost  performance  with  its 
predicted  future  performance.  The  other 
technique  involves  comparing  a  range  of 
estimates  found  to  be  accurate  on  a  large 


number  of  completed  projects  with  the 
predicted  final  cost  of  the  ongoing  project. 

Although  the  example  is  taken  from  a 
large,  criteria-consistent  defense  contract, 
the  basic  analysis  techniques  described  in 
this  article  apply  to  projects  of  any  size, 
government  or  commercial.  Versions  of 
the  DoD’s  EVMS  criteria  have  been  used 
for  many  years  by  nondefense  agencies, 
including  the  Department  of  Transporta¬ 
tion,  Department  of  Energy,  and  National 
Aeronautics  and  Space  Administration.  In 
recent  years,  earned  value  management 
systems  and  the  resulting  data  from  those 
systems  have  been  used  to  manage  com¬ 
mercial  projects  in  the  United  States  and 
abroad  (Abba,  1995). 

The  Terminology  of  Earned 
Value  IWahagement  Reports _ 

Terminology  used  in  earned  value  man¬ 
agement  reports  can  be  confusing.  The 
acronyms  alone  number  in  the  dozens. 
Regardless  of  the  kind  of  project  (defense, 
space,  construction,  etc.),  however,  only 
three  basic  data  elements  listed  on  the 
earned  value  management  report  are  cen¬ 
tral  to  proper  planning,  measurement,  and 
analysis:  budgeted  cost  for  work  sched¬ 
uled  (BCWS),  budgeted  cost  for  work 
performed  (BCWP),  and  actual  cost  of 
work  performed  (ACWP).  Nearly  all  of 
the  other  data  items  may  be  derived  from 
them. 

The  BCWS  is  the  budget  for  work 
scheduled  to  be  completed.  It  can  be  either 
monthly  or  cumulative.  As  a  monthly 
amount,  it  represents  the  amount  of 
work  scheduled  to  be  completed  for  that 
month.  As  a  cumulative  amount,  it  rep¬ 
resents  the  amount  of  work  scheduled  to 
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be  completed  to  date.  BCWS  is  also 
known  as  “planned  value.” 

The  BCWP  is  the  budget  for  the  com¬ 
pleted  work.  It  also  can  be  either  monthly 
or  cumulative.  Monthly  BCWP  represents 
the  amount  of  work  completed  during  a 
month;  cumulative  BCWP  represents  the 
amount  of  work  completed  to  date.  BCWP 
is  also  known  as  “earned  value.” 

The  ACWP  is  the  actual  cost  incurred 
in  accomplishing  the  work  within  a  given 
period.  Like  the  budgets,  both  direct  and 
indirect  costs  are  included.^  To  permit 
meaningful  comparisons,  the  ACWP 
should  be  recorded  in  the  same  time  period 
as  BCWP  for  a  given  piece  of  work. 

At  the  start  of  a  project,  work  is  typi¬ 
cally  categorized  into  near-term  and  far- 
term  effort.  The  near-term  effort  is  divided 
into  manageable  pieces  known  as  work 
packages.  On  a  large  project,  there  may 


be  more  than  100,000  work  packages  that 
must  be  performed  before  the  project  is 
completed.  As  a  result,  only  the  near-term 
work  is  planned  in  detail.  The  remaining 
work  is  known  as  planning  packages.  As 
the  project  progresses,  the  planning  pack¬ 
ages  are  systematically  divided  into  work 
packages  and  planned  in  detail. 

Regardless  of  the  timing  of  the  work,  a 
budget  in  terms  of  hours,  dollars,  or  other 
measurable  units  is  assigned  to  each  work 
and  planning  package.  By  summing  their 
budgets,  a  time-phased  budgetary  baseline 
for  the  entire  project  is  defined.  This 
baseline,  known  as  the  performance  mea¬ 
surement  baseline  (PMB),  represents  the 
standard  or  plan  against  which  the  perfor¬ 
mance  (BCWP)  and  the  cost  (ACWP)  of 
the  project  are  compared. 

Figures  1  and  2  illustrate  the  typical  con¬ 
dition  of  many  projects:  behind  schedule 


Figure  1. 

Performance  Measurement  Baseline  (Without  Technical  Jargon) 
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Figure  2. 

Perffermance  Measurement  Baseline  (With  Technical  Jargon) 


and  over  budget.  Figure  1  uses  nontech¬ 
nical  jargon.  Figure  2  uses  the  technical 
jargon  just  described.  The  PMB  represents 
the  plan.  Because  less  work  has  been  com¬ 
pleted  (in  terms  of  dollar  value)  than  was 
planned  to  be  completed  at  this  point,  a 
schedule  slippage  (adverse  schedule 
variance)  is  identified.  Similarly,  because 
actual  costs  exceed  the  budget  for  the  com¬ 
pleted  work,  an  unfavorable  cost  variance 
is  identified. 

The  figures  also  illustrate  a  third  vari¬ 
ance.  The  variance  at  completion  (VAC) 
is  the  difference  between  the  total  budget 
of  the  project,  termed  the  budget  at 
completion  (BAC),  and  the  estimated 
total  cost  of  the  project,  termed  the  esti¬ 
mate  at  completion  (EAC).  In  this  case, 
an  adverse  VAC  (estimated  final  overrun) 
is  indicated. 


When  these  variances  are  judged  sig¬ 
nificant  they  are  immediately  investigated 
by  managers  who  are  empowered  to  take 
appropriate  corrective  action.^  The  cost 
management  report  summarizes  the 
monthly  cost  and  schedule  status  of  the 
project  by  listing  the  three  data  elements, 
the  related  variances,  the  BAC,  and  the 
revised  EAC  for  all  of  the  major  pieces  of 
work  on  the  project. 

The  report  also  describes  the  causes  of 
the  variances  and  the  corrective  action 
plans  related  to  the  variances.  Typical 
causes  of  variances  include  poor  initial 
planning  or  budgeting,  changes  to  the 
project’s  scope,  changes  in  technology 
related  to  the  project,  changes  to  the  delivery 
schedule,  changes  to  labor  contracts, 
changes  to  material  costs,  inflation,  and 
measurement  error.  Inaccurate  indirect 
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cost  allocations  can  also  contribute  to  cost 
variances  reported  on  defense  contracts. 
The  project’s  PMB  includes  indirect  cost 
as  well  as  direct  cost.  In  addition,  ACWP 
includes  indirect  costs,  and  defense  con¬ 
tractors  must  investigate  all  significant 
cost  variances,  including  indirect  cost 
variances.  The  Defense  Contract  Audit 
Agency  (DCAA)  is  usually  given  the 
responsibility  for  ensuring  that  the 
contractor’s  indirect  cost  management 
systems  are  in  compliance  with  the 
criteria."^ 

Eventually,  summarized  portions  of  the 
cost  management  report  reach  the  Office 
of  the  Secretary  of  Defense  (OSD)  and 
Congress,  where  they  may  be  used  to  help 
determine  the  continued  funding  of  the 
project.^  Only  rarely  has  a  large  cost  over¬ 
run  on  a  defense  contract  resulted  in  the 
project’s  cancellation.  However,  Congres¬ 
sional  oversight,  the  threat  to  cancel  fund¬ 
ing,  and  the  budget  discipline  required  by 
the  criteria  may  have  limited  cost  growth 
on  defense  projects.  Although  the  average 
cost  overrun  on  defense  contracts  has 
averaged  about  20  percent  since  the  mid- 
1960s,  cost  overruns  on  some  nondefense 
projects  of  comparable  size  and  complex¬ 
ity  have  been  larger  (Drezner,  Jarvaise, 
Hess,  Hugh,  and  Norton,  1993,  p.  xiv). 

Evaluating  the  Contractor's 
Estimate  at  Completion 


From  the  contractor’s  and  the  govern¬ 
ment’s  perspectives,  the  contractor’s  EAC 
is  one  of  the  more  critical  numbers  on  the 
cost  management  report.  The  contractor 
is  required  to  advise  the  government  of 
potential  significant  overruns  or  under¬ 
runs.  In  some  cases  the  EAC  is  used  to 


adjust  progress  payments  (DCAA,  1996, 
paras.  11-207,  14-205).  Deficiencies  in 
determining  or  revising  the  EAC  may  sig¬ 
nificantly  affect  forward  pricing  propos¬ 
als,  billing  requests,  and  the  reliability  of 
the  VAC  as  a  control  variance  (Dahlberg, 
Colantuono,  and  Fischer,  1992,  p.  9). 

Given  its  importance,  the  EAC  is  peri¬ 
odically  revised  by  the  contractor  and 
closely  monitored  by  the  government. 
Contractors  periodically  develop  “compre¬ 
hensive”  EACs  by  estimating  and  aggre¬ 
gating  the  costs  of  incomplete  work  and 
planning  pack-  ' 

ages  remaining  its 

onthecontract.*  i„p*rtonce,  the 
In  addition,  the  eAC  is  periodically 
contractor’s  revised  by  the  con- 
EAC  is  exam-  tractor  and  closely 
ined  monthly’  moaltored  by  the  . 
for  accuracy  governmenl." 
and  revised  as 

necessary  to  ensure  that  resource  require¬ 
ments  are  realistic  and  properly  phased 
(DoD,  1996,  para.  3-6e).  Whenever  the 
EAC  is  changed,  the  contractor  should 
explain  the  rationale  in  the  cost  manage¬ 
ment  report  that  is  sent  to  the  government. 
Frequent  revisions  of  the  EAC  are  not 
necessarily  considered  evidence  of  its 
unreliability.  On  a  multiyear  defense  pro¬ 
ject,  an  unchanging  EAC  would  be 
suspicious. 

Despite  the  discipline  required  by  the 
criteria,  a  RAND  study  recently  concluded 
that  EACs  have  been  systematically 
understated  for  more  than  20  years 
(Drezner  et  al.,  1993).  Because  a  system¬ 
atic  bias  in  the  EAC  can  adversely  affect 
the  resource  allocation  decisions  made  by 
Congress  and  eventually  the  effectiveness 
of  defense  policy,  it  is  important  to  know 
how  to  identify  an  understated  EAC.  The 
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The  A-12 


remainder  of  this  article  describes  three 
simple  analysis  techniques  that  may  be 
useful  in  evaluating  the  accuracy  of  the 
contractor’s  EAC.  Cost  performance  data 
from  the  Navy’s  A-12  program  is  used  to 
illustrate  the  techniques^ 

The  A-12  was  the  Navy’s  premier  avia¬ 
tion  project.  In  January  1991,  Secretary 
of  Defense  Richard  Cheney  canceled  the 
project,  complaining  that  no  one  could  tell 
him  what  the  final  cost  of  the  project 
would  be.  In  fact,  there  were  many  EACs, 
some  more  credible  than  others.  Unfortu¬ 
nately,  the  more  credible  EACs  were  not 
reported  on  the  CPR  or  the  summary 
reports  sent  to  the  Office  of  the  Secretary 
of  Defense.^  A  Navy  investigation  of  the 


A-12  cancellation  revealed  that  adverse 
information  about  the  A-12  may  have 
been  suppressed  by  the  Navy  Program 
Office.  The  Navy’s  “inquiry  officer”  on 
the  cancellation  of  the  A-12  program,  C. 
P.  Beach,  Jr.,  concluded  that  schedule  and 
cost  goals  for  the  A-12  were  too  optimis¬ 
tic  and  should  not  have  been  supported 
by  government  managers  in  the  contract 
and  program  offices  (Beach,  1990,  p.  39- 
41).  Table  1  shows  the  April  1990  cost 
performance  data  for  the  A-12,  six  months 
before  the  project  was  canceled. 

To  evaluate  the  reasonableness  of  the 
contractor’s  EAC,  three  comparisons 
should  be  made.  First,  the  overrun  to  date 
(cost  variance,  CV)  should  be  compared 


Table  1. 


Cost  Performance  Data  for  A~%2  Proiect 
(April  1990,  Millions  of  Dollars) 


Month 

BCWS 

BCWP 

ACWP 

SV 

CV 

BAG 

EAC 

VAC 

April 

2,080 

1,491 

1,950 

(589) 

(459) 

4,046 

4,400 

(354) 
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to  the  estimated  final  overrun  (VAC).  If 
the  overrun  to  date  is  worse  than  the 
estimated  final  overrun,  the  contractor  is 
predicting  a  recovery.  Thus,  in  April  1990 
the  A- 1 2  contractors  predicted  a  recovery 
of  $  1 05  million  ($459  million  to  $354  mil¬ 
lion).  Recoveries  from  cost  overruns  on 
defense  contracts  are  extremely  rare,  es¬ 
pecially  when  the  project  is  more  than  20 
percent  completed.  In  this  case,  the  project 
is  about  37  percent  complete  (BCWPcum/ 
BAC).  Analysts  should  have  been 
extremely  dubious  about  the  ability  of  the 
A-12  project  to  finish  at  $4.4  million.  The 
report  on  the  A-12  cancellation  indicated 
that  the  Navy  cost  analyst  who  was  re¬ 
sponsible  for  analysis  of  the  A- 12  CPR 
briefed  higher,  more  realistic  EACs  to  the 
Navy  Program  Office.  But  the  program 
manager  chose  to  rely  on  a  lower,  more 
optimistic  EAC  and  reported  it  to  higher 
level  decision  makers  as  the  “most  likely” 
EAC  (Beach,  1990,  p.  13). 

The  second  comparison  uses  two  per¬ 
formance  indices:  the  cost  performance 
index  (CPI)  and  the  to-complete  perfor¬ 
mance  index  (TCPI).  As  Equation  1 
shows,  the  CPI  measures  the  budgeted  cost 
of  completed  work  against  the  actual  cost. 
If  the  CPI  is  less  than  one,  an  unfavorable 
cost  variance  is  indicated.  In  this  case,  the 
CPI  is  0.76  (1491  /  1950),  which  means 
that  for  every  dollar  spent,  $0.76  of  work 
has  been  completed. 

CPI  =  BCWP/ACWP  (1) 

As  shown  in  Equation  2,  the  TCPI 
measures  the  budget  for  the  remaining 
work  (BAC-BCWPcum)  against  the 
estimated  cost  to  achieve  the  EAC  (EAC 
-  ACWPcum).  In  this  case,  the  TCPI  is 
1.04,  indicating  $1.04  of  work  to  be 


completed  for  every  dollar  spent.  Research 
on  completed  defense  contracts  shows  that 
the  cumulative  CPI  does  not  change  by 
more  than  10  percent  from  its  value  at  the 
20  percent  completion  point,  and  in  most 
cases  only  worsens  (Christensen  and 
Heise,  1993).  Thus,  when  the  cumulative 
CPI  is  significantly  less  than  the  TCPI,  it 
is  highly  doubtful  that  the  contract  will 
be  completed  at  the  EAC.  In  the  A-12 
case,  this  simple  comparison  indicates  that 
the  EAC  was  too  small.  More  realistic 
EACs  could  have  been  computed  using 
the  simple  formula  shown  in  Equation  3. 

TCPI  =  (BAC  -  BCWPcum)  /  (EAC  -  ACWPcum) 

(2) 

EAC  =  ACWPcum  +  (BAC  -  BCWPcum)  / 
Performance  factor  (3) 

The  final  comparison  involves  gener¬ 
ating  a  range  of  “independent”  EACs  using 
the  generic  formula  shown  in  Equation  3. 
Figure  1  illustrates  that  the  EAC  can  be 
estimated  by  extrapolating  ACWPcum  to 
the  end  of  the  project.  More  specifically. 
Equation  3  indicates  that  ACWPcum  is 
extrapolated  by  simply  adding  ACWPcum 
to  the  budget  for  the  remaining  work  (BAC 
-  BCWPcum),  adjusted  by  applying  a 
performance  factor.  The  performance  fac¬ 
tor  may  reflect  the  analyst’s  expectations 
about  the  future  performance  on  the  con¬ 
tract.  Using  data  from  hundreds  of  com¬ 
pleted  defense  contracts,  researchers  have 
concluded  that  past  performance  on 
defense  contracts  is  predictive  of  the  future 
(Christensen  and  Heise,  1993;  Drezner  et 
al.,  1993),^  Hence,  the  performance  factor 
used  in  Equation  3  is  often  either  the  CPI, 
the  schedule  performance  index  (SPI),  or 
some  combination  of  the  two  indices. 
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Table  2. 

A  Range  of  Estimates  at  Completion  for  the  A-12 
(Derived  from  the  Cumulative  Performance  Data  in  Tabie  1) 


Performance  factor 

Performance  factor  value 

EAC  (Millions) 

CPI  X  SPI 

0.5481 

$6,612 

SPI 

0.7168 

$  5,514 

.8  CPI  X  .2  SPI 

0.7551 

$  5,334 

CPI 

0.7646 

$  5,292 

Equation  4  shows  the  formula  for  the 
SPI.  An  SPI  that  is  less  than  one  indicates 
an  unfavorable  schedule  variance.  In  the 
A-12  case,  the  SPI  is  0.72,  indicating  that 
for  every  dollar  of  work  scheduled  to  be 
accomplished,  only  $0.72  was  accom¬ 
plished.  In  other  words,  the  contract  was 
behind  schedule  as  well  as  over  budget. 
Because  scheduling  problems  often 
require  additional  funding  to  correct,  an 
unfavorable  SPI  may  be  predictive  of 
future  cost  overruns  (Christensen, 
•  >  Antolini,  and  McKinney,  1995). 

SPI  =  BCWP/BCWS  (4) 


(Christensen,  1996).  Also,  the  EAC  based 
on  the  product  of  CPI  and  SPI  is  usually 
quite  large  because,  historically,  most 
defense  contracts  finish  behind  schedule 
and  over  budget  (Christensen,  1994; 
Drezner  et  al.,  1993).  When  a  contract  is 
behind  schedule  and  over  budget,  the  SPI 
and  the  CPI  are  each  less  than  one.  On 
April  1990,  the  SPI  and  CPI  of  the  A-12 
were  0.7168  (=1491  /  2080)  and  0.7646 
(=1491  /  1950),  respectively.  When  these 
two  performance  indices  are  multiplied 
together,  the  product  is  less  than  either 
index  by  itself  (0.7168  x  0.7647  =  0.5481), 
and  the  resulting  EAC  is  very  large. 


Table  2  shows  four  popular  perfor¬ 
mance  factors  (CPI,  SPI,  0.8  CPI  +  0.2 
SPI,  CPI  X  SPI)  and  the  resulting  EACs 
using  the  A-12  data.^^  If  this  range  of 
EACs  is  considered  reasonable,  the  $4,400 
million  EAC  reported  by  the  contractors 
is  clearly  understated.  Note  that  the  small¬ 
est  and  largest  EACs  were  derived  from 
the  CPI  and  the  product  of  CPI  and  SPI, 
respectively.  This  is  expected.  Research 
has  shown  that  the  EAC  derived  from  the 
CPI  is  a  reasonable  floor  to  the  final  cost 


Conclusion 


The  use  of  earned  value  is  accelerating 
worldwide.  Although  it  began  in  industry, 
it  was  developed  and  used  primarily  on 
U.S.  defense  contracts.  The  association 
with  the  DoD’s  cost/schedule  control 
systems  criteria  may  have  created  a  mis¬ 
conception  that  earned  value  is  inappro¬ 
priate  for  smaller,  nongovernment 
projects.  But  earned  value  and  the  related 
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cost  management  reports  can  be  used  with¬ 
out  the  criteria  on  projects  of  any  size.  On 
large  government  projects,  where  the  risk 
of  cost  growth  is  often  carried  by  the 
government,  the  planning  and  control 
discipline  fostered  by  the  criteria  is  essen¬ 
tial.  On  other  kinds  of  projects,  a  full-scale 
application  of  the  criteria  is  not  necessary 
(Fleming  and  Koppelman,  1996).  As  a 
result,  other  U.S.  government  agencies, 
governments  of  other  countries,  and 
companies  across  the  world  have  accepted 
earned  value  as  an  effective  project 
management  tool  (Abba,  1995, 1997). 


The  simple  analysis  methods  described 
here  illustrate  one  beneficial  use  of  earned 
value  data:  evaluating  the  reasonableness 
of  the  contractor’s  EAC.  Although  the 
acronyms  and  technical  jargon  used  in 
project  management  can  be  confusing,  the 
cost  management  report  prepared  from 
earned  value  data  can  provide  project 
managers  with  valuable  insight  into  the 
cost  and  schedule  status  of  their  project. 
When  used  properly,  the  variances  and 
performance  indices  can  help  a  manager 
focus  attention  on  emerging  problems.  The 
cost  management  report  is  not  a  financial 
report.  It’s  a  tool  for  project  managers. 
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Ehdmotes 


1 .  More  formally,  earned  value  is  defined 
as  “the  value  of  completed  work  ex¬ 
pressed  in  terms  of  the  budget  as¬ 
signed  to  that  work”  (DoD,  1996,  p. 
63). 

2.  Indirect  cost  may  not  be  allocated  to 
the  detailed  levels  of  the  work  (e.g., 
control  accounts  and  work  packages). 

3 .  Historically,  a  significant  variance  was 
one  that  exceeded  a  prespecified  limit 
(e.g.,  percentage  of  the  budget,  or  a 
dollar  amount,  or  both).  When  applied 
arbitrarily  to  all  levels  of  work  on  the 
contract,  it  can  result  in  excessive 
analysis  and  reporting.  Recently,  defi¬ 
nitions  of  significance  have  been 
modified  to  reduce  the  number  of 
frivolous  variance  investigations  and 
reports. 

4.  Presently,  there  is  no  requirement  that 
promising  cost  assignment  methods 
like  activity-based  costing  (ABC)  be 
used.  But  the  criteria  are  not  incom¬ 
patible  with  ABC,  and  DCAA  is  not 
blocking  defense  contractors  from 
adopting  it  (Oyer,  1992). 

5 .  Cost  management  data  on  Acquisition 
Category  I  (ACAT  I)  programs  are 
routinely  summarized  by  program 
offices  and  sent  to  the  Office  of  the 
Secretary  of  Defense  for  inclusion  in 
the  Defense  Acquisition  Executive 
Summary  (DAES)  data  base.  In  addi¬ 
tion,  selected  data  from  the  CPR  are 
included  in  a  comprehensive  annual 
report  of  ACAT  I  programs  to  Congress. 


6.  The  criteria  do  not  specify  how  fre¬ 
quently  the  comprehensive  EAC 
should  be  developed.  The  Earned 
Value  Management  Implementation 
Guide  (DoD,  1996)  recommends  that 
the  comprehensive  EAC  be  developed 
“periodically”  at  the  control  account 
level  (para  3-6e). 

7 .  Each  of  the  Services  has  had  programs 
with  severe  cost  and  schedule  prob¬ 
lems.  According  to  Abba  (1995,  p.  1), 
“Cost  problems  on  the  Army’s 
AAWS-M  (Javeline)  and  the  Air 
Force’s  C-17  were  all  shown  to  be 
foreseeable,  if  not  avoidable,  using 
earned  value  reports  from  the  contrac¬ 
tors’  C/SCSC  management  control 
systems.” 

8.  The  special  access  nature  of  the  pro¬ 
gram  interfered  with  higher  level  over¬ 
sight  of  the  A-12’s  cost  performance. 
For  example,  the  cost  management 
staff  at  the  Office  of  the  Secretary  of 
Defense  (OSD)  was  not  cleared  for  ac¬ 
cess  to  the  data  until  March  1990. 
Adverse  cost  and  schedule  variances 
that  would  have  normally  prompted 
investigations  by  OSD  were  delayed 
by  more  than  a  year  (Beach,  1990, 
pp.7-8). 

9.  For  example,  using  a  sample  of  155 
contracts  and  an  alpha  of  5  percent, 
Christensen  and  Heise  reported  that 
the  cumulative  CPI  does  not  change 
by  more  than  10  percent  from  its  value 
at  the  20  percent  completion  point. 
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10.  An  unfavorable  schedule  variance 
does  not  necessarily  imply  that  work 
is  behind  schedule.  By  itself,  the  SPI 
reveals  no  critical  path  information. 
The  SPI  should  be  used  in  conjunc¬ 
tion  with  other  schedule  information 
(Fleming,  1992). 

1 1 .  Christensen  et  al.  (1995)  reviewed  25 
studies  that  compared  the  accuracy  of 
dozens  of  EAC  formulas.  The  most 
accurate  formulas  used  the  CPI,  the 
SPI,  or  the  CPI  x  SPI  as  the  perfor¬ 
mance  factor.  In  addition,  defense 


manuals  that  describe  the  EAC  calcu¬ 
lation,  and  standard  DoD  CPR  analy¬ 
sis  software,  invariably  include  these 
index-based  formulas  as  standard  op¬ 
tions  in  computing  the  EAC.  Because 
cost  and  schedule  problems  can  drive 
future  costs,  using  both  CPI  and  the 
SPI  in  the  performance  factor  is  popu¬ 
lar.  Multiplying  the  CPI  by  the  SPI  is 
a  crude  but  simple  attempt  to  adjust 
the  CPI  by  the  adverse  influence  that 
schedule  problems  can  have  on  cost 
growth. 
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TUTORIAL 


THE  PROBLEM  WITH 
AVIATIOH  COTS 

If  Col  Uonel  0.  JUhrd,  Jr^  U5JV 


Commercial  off  the  shelf  (COTS)  has  become  a  byword  for  acquisition  reform, 
but  there  are  significant  risks  associated  with  the  use  of  COTS  products  in 
military  systems.  These  risks  are  especially  acute  for  aviation  systems.  This 
article  explains  how  COTS  can  negatively  affect  military  acquisitions  and  gives 
ideas  on  how  to  plan  and  resolve  COTS-caused  problems. 


To  take  advantage  of  the  fast  pace  of 
technological  advances  in  industry, 
the  Department  of  Defense  (DoD)  is 
acquiring  commercial  products  and 
components  for  use  in  military  systems. 
Using  these  commercial  items,  called 
commercial  off  the  shelf  (COTS),  provides 
the  DoD  with  numerous  potential  benefits. 
Primarily,  COTS  purchasing  allows 
military  acquisition  to  incorporate  new 
technology  into  military  systems  more 
quickly  than  do  typical  developmental 
programs.  COTS  can  also  reduce  research 
and  development  costs.  Even  more  impor¬ 
tant,  the  DoD  has  looked  to  COTS  pur¬ 
chases  to  help  reduce  operations  and  sup¬ 
port  costs  for  military  systems.  Figure  1 
shows  why  this  is  highly  desired  by  the 
DoD;  the  cost  of  operations  and  support 
is  almost  three  quarters  the  overall  cost  of 
a  typical  system  (Jones,  1994;  Phillips, 
1996). 


With  this  in  mind,  what  could  be  the 
worst  misfortune  to  befall  an  item  pro¬ 
cured  as  COTS?  What  if  the  item  changed 
and  the  original  was  no  longer  available 
commercially?  What  if  its  commercial 
replacement  would  no  longer  work  in  the 
military  system  for  which  it  was  procured? 
The  very  worst  misfortune,  which  incor¬ 
porates  both  of  these  problems,  would  be 
if  the  item  were  suddenly  to  become 
government-unique,  with  no  replacement 
available  commercially.  Becoming 
government-unique  wouldn’t  entirely 
defeat  the  purpose  of  a  COTS  acquisition, 
but  it  would  significantly  affect  support, 
the  longest  tail,  and  as  Figure  1  shows, 
the  greatest  cost  in  the  acquisition  life 
cycle. 

This  misfortune  could  never  affect  our 
COTS  procurement — or  could  it?  When 
you  have  finished  reading  this  article,  you 
will  realize  that  not  only  can  it  affect  your 
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Source;  Jones  (1994)  and  Phillips  (1996). 

Figure  1.  Typical  Cost  Distribution  of  a  System 


COTS  procurement,  but  if  you  are 
acquiring  aviation  parts  and  systems,  it 
probably  already  has.  In  any  COTS 
acquisition,  the  acquirer  needs  to  have 
already  planned  and  prepared  for  this 
eventuality.  This  article  shows  how  to  plan 
for  and  gives  ideas  on  how  to  constrain 
this  COTS  problem. 

A  COTS  item  can  become  government- 
unique  whenever  the  manufacturer 
discontinues  or  makes  a  change  to  the 
item.  If  the  item  is  changed,  its  original 
becomes  government-unique  when  the 
government  either  doesn’t  acquire  the 
variant  or  doesn’t  reflect  the  change  in  the 
systems  incorporating  the  item  and  the 
systems’  documentation.  (A  system,  in 


this  definition,  is  the  higher-level  mission 
component  that  the  item  is  procured  to 
support.  For  example,  an  aircraft  and  its 
support  equipment  is  a  system;  a  radio 
installed  in  the  aircraft  is  an  item.) 

After  a  manufacturer  makes  a  change 
to  an  item,  its  new  variant  might  possibly 
be  purchased  and  used  without  any 
negative  effect  to  the  system  for  which  it 
was  procured.  In  this  case,  even  though 
the  original  item  is  now  government- 
unique,  the  change  didn’t  affect  the  form, 
fit,  interface,  or  mission  characteristics 
of  the  device.  Unfortunately,  manufac¬ 
turers’  changes  routinely  affect  form,  fit, 
interface,  and  mission  characteristics, 
and  the  effects  of  these  COTS  item 
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changes  for  systems  incorporating  them 
are  significant. 

The  problems  of  changing  form,  fit,  and 
interface  should  be  obvious;  these  char¬ 
acteristics  generally  cannot  change  if  the 
variant  item  is  to  be  installed  and  to  oper¬ 
ate  correctly.  The  acquirer  must  usually 
make  modifications  to  the  system  to 
accommodate  form,  fit,  and  interface 
changes.  Changes  to  mission  characteris¬ 
tics  do  not  necessarily  result  in  modifica¬ 
tions  to  the  system,  but  they  can  cause 
significant  problems  if  they  affect  the  over¬ 
all  ability  of  the  system  to  perform.  For 
example,  if  the  new  item  has  a  tempera¬ 
ture  range  less  than  the  original,  the  system 
could  possibly  fail  when  it  is  used  outside 
the  bounds  of  that  temperature  range. 


The  most  devastating  cause  of  govern¬ 
ment-uniqueness  is  when  a  manufacturer 
discontinues  an  item.  Figure  2  shows  that 
for  a  large  number  of  COTS  acquisitions, 
this  result  is  inevitable  (U.S.  Air  Force 
Program  Executive  Office).  The  life  of  a 
typical  military  acquisition  exceeds  20 
years,  yet  the  life  of  a  typical  civil  prod¬ 
uct,  especially  in  electronics,  is  much  less. 
From  our  own  experience  we  know  that  it 
is  almost  impossible  to  purchase  an 
“ancient”  Z80-based  computer,  but  right 
now  the  Z80  lives  on  in  the  Air  Force’s 
AP-102  computer.  This  problem  is  not 
isolated  to  the  electronics  industry.  For 
example,  aviation  “steam  gauges,”  the 
mechanical  gauges  on  instrument  panels, 
are  becoming  nearly  impossible  to  obtain 
— electronic  gauges  are  replacing  them. 


Introduction  Growth  /  Maturity  \  Saturation  Obsolescence 


Commercial  Requirement 


Military  Requirement 


Beginning  of  Peaking  Dropping  No  Part 
Military  Use  Military  Use  Supply  Source 


Source:  U.S.  Air  Force  Program  Executive  Office  (199?), 


Figure  2.  COTS  Obsolescence 


A€qyisifiott  Review  Quarterly— Semmer  7999 


The  above  concepts  provide  the  defini¬ 
tive  framework  under  which  COTS  must 
be  understood:  The  manufacturer  is  free 
to  make  changes  to  or  even  discontinue 
the  manufacture  of  the  COTS  item  with¬ 
out  notice.  As  long  as  item  changes  don’t 
affect  form,  fit,  interface,  mission  charac¬ 
teristics,  or  supply,  there  is  no  problem 
for  the  acquirer.  The  problem  is  that  the 
acquirer  has  no  control  over  these  changes. 
When  changes  do  affect  form,  fit,  inter¬ 
face,  mission  characteristics,  or  supply, 
these  changes  become  a  significant  prob¬ 
lem  for  any  COTS  acquisition.  This  is 
especially  true  for  aviation  COTS. 


Aviation-specific  Problems 


The  effect  of  a  manufacturer’s  changes 
to  aviation  COTS  can  be  boiled  down  to 
two  specific  difficulties,  airworthiness  and 
forced  modifications.  Airworthiness  is  the 
primary  safety  characteristic  of  any  air¬ 
craft.  It  is  the 
primary  ele¬ 
ment  proven  in 
the  testing  of 
the  aircraft.  The 
Federal  Avia¬ 
tion  Adminis¬ 
tration  (FAA) 
certifies  the  air- 
,  worthiness  of 
most  COTS  items  for  aircraft.  These  items 
must  be  certified  in  the  system  as  well  as 
individually. 

Military  system  certification,  except  for 
FAA-certified  aircraft,  is  accomplished 
wholly  by  the  aircraft’s  configuration 
management  (CM)  authority.  What 
this  means  for  COTS  articles  is  that  a 
simple  change  of  mission  characteristics. 


effect  of 

a  manufacturer's 
^changes  to  aviation 
COTS  can  be  boiled! 
dovm  to  two  specific 
dlifficuities,  airwor** 
thiness  and  forced 
modifications." 


including  improved  functionality,  will 
always  drive  a  recertification  of  the  air¬ 
craft.  This  recertification  can  range  from 
a  paper  review  to  full  flight  test.  Consid¬ 
ering  the  rate  of  change  of  COTS  items, 
this  is  a  daunting  prospect  for  the  CM 
authority.  In  addition,  COTS  item  changes 
can  also  drive  a  change  to  the  specifica¬ 
tions  and  technical  data  of  any  system  on 
which  these  items  are  installed — also  a 
daunting  prospect. 

The  other  difficulty  for  aviation  COTS, 
which  also  affects  any  system,  is  forced 
modifications.  A  forced  modification  is 
one  that  is  caused  by  the  change  of  form, 
fit,  interface,  function,  mission  character¬ 
istic,  or  supply  of  the  item.  When  supply 
is  affected,  the  acquirer  must  support  the 
discontinued  item  or  find  a  replacement. 
The  latter  may  force  a  modification. 

More  common  in  aviation  COTS  is  an 
FAA-directed  change  to  an  item  called  an 
airworthiness  directive  (AD)  FAA,  1996).^ 
Airworthiness  directives  are  Federal  Avia¬ 
tion  Regulation  (FAR)-based  orders  that 
mandate  a  change  to  an  aviation  item  or 
system.  These  directives  are  regulatory  in 
nature  and  “no  person  may  operate  a 
product  to  which  an  airworthiness  direc¬ 
tive  applies  except  in  accordance  with 
the  requirements  of  that  airworthiness 
directive”  (FAA,  1996). 

The  manufacturer  has  two  choices  in 
implementing  the  AD:  Discontinue  the 
product  or  make  the  required  change.  The 
user  of  the  item  also  has  two  choices:  Get 
a  replacement  product,  if  available,  or 
make  the  changes  required  by  the  direc¬ 
tive.  When  the  change  affects  the  form, 
fit,  or  interface  of  the  item,  an  AD  forces 
a  modification  to  the  system  to  accom¬ 
modate  the  item.  For  FAA-certified 
aircraft,  the  system  must  also  be  certified 
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by  the  FAA  for  flight.  For  government- 
certified  aircraft,  to  comply  with  such  an 
AD,  the  CM  authority  must  modify  the 
system  and  certify  airworthiness. 

But  there  is  no  requirement  for  the 
government  to  change  its  COTS  items  to 
accommodate  an  AD.  In  such  cases,  the 
item  becomes  government-unique. 
Because  the  government  self-certifies,  it 
is  not  uncommon  for  non-FAA-certified 
government  aircraft  to  not  make  AD- 
directed  changes. 

Further,  because  the  government  in 
many  cases  does  not  subscribe  to  techni¬ 
cal  changes  from  manufacturers,  the  CM 
authority  may  not  be  aware  of  ADs  to  a 
system’s  components. 

This  problem  is  exacerbated  when  the 
CM  has  established  a  depot  for  a  COTS 
acquisition  and  is,  in  that  case,  support¬ 
ing  the  component  without  knowledge  of 
or  real  commonality  with  the  original  item. 
ADs  are  not  an  isolated  or  uncommon 
problem.  In  the  case  of  aircraft,  ADs 
normally  occur  more  than  once  per  year 
on  even  well-established  air  vehicles,  and 
it  is  typical  to  have  thousands  of  ADs 
affecting  a  single  aircraft  model. 

All  this  boils  down  to  the  fact  that,  for 
aviation,  a  COTS  item  will  become  gov¬ 
ernment-unique  in  a  very  short  period  of 
time — from  a  few  months  to  a  year  after 
the  acquisition  of  the  item.  Government 
uniqueness  means  forced  review,  modifi¬ 
cation,  support  changes,  and  recertifica¬ 
tion  when  the  change  is  recognized — or 
blissful  ignorance  and  risk  if  the  change 
is  not  recognized. 


Some  Solutions 


What  can  be  done  to  prevent  these 
problems  for  aviation  systems  specifically 
and  all  systems  generally?  One  solution 
has  been  hinted  at,  and  this  solution  has 
been  accomplished  with  varying  degrees 
of  success  since  the  first  acquisition  of 
COTS  items.  This  is  the  acknowledgment 
of  an  item’s  potential  government-unique¬ 
ness  before  the  manufacturer  makes  any 
changes.  In  this  strategy,  the  acquirer 
purchases  spares  and  builds  a  government 
depot  activity  to  support  the  item.  This 
solution  does  take  advantage  of  the  COTS 
item  commer- 
cial  develop-  - 

ment,  but  the  -  "Another  solution 

overall  cost  sav-  :  *•  ••  punh"® 

ings  may  not  be  -  f?."'®* 

•  ^  u  '  the  total  life  of  the 

significant  be-  __  j  1,.^  „ 

cause  the  long¬ 
est  tail — the 

support  tail — is  at  least  as  long  as  any 
normal  government  item  development.  In 
fact,  the  support  tail  may  be  costlier 
because  the  government  has  not  been 
involved  in  the  item  development. 

Many  programs  use  this  strategy;  the 
C-1 30  improved  auxiliary  power  unit  pro¬ 
gram  is  one  example.  Another  solution  is 
to  purchase  enough  spares  for  the  total  life 
of  the  system  and  item.  The  AP-102  com¬ 
puter  program  used  this  strategy  to  ensure 
sufficient  Z80  chips  to  support  the  life  of 
the  system.  Again,  this  is  not  an  optimum 
solution  because  it  usually  increases  the 
item’s  logistics  tail.  In  this  case,  if  the 
item’s  life  expectancy  is  less  than  pre¬ 
dicted  or  the  item’s  life  is  extended,  the 
government  has  no  other  recourse  than  to 
entirely  replace  the  item  or  to  develop  a 
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support  capability.  These  two  solutions, 
government  depot  and  lifetime  spares  buy, 
prevent  forced  modifications  and  subse^ 
quent  airworthiness  certification  require¬ 
ments,  but  as  discussed  above,  they  also 
can  introduce  risk.  They  also  defeat  two 
major  potential  advantages  of  COTS: 
the  ability  to  reduce  the  support  tail  and 
the  chance  to  take  advantage  of  future 
commercial  developments  in  the  item. 

There  exist  four  other  solutions  to  these 


problems  that  do  take  full  advantage  of 
the  possibilities  of  COTS  acquisition,  but 
they  are  each  fraught  with  their  own  risks, 
x;  -  '  ■  Each  is  a  variant 


"There  exist  four 

ether  solutions  to  , 

these  problems  as  contractor  lo- 

thot  do  take  full  gistics  support 
adhrantage  of  the  ,  (CLS).  In  the 
pessibilities  of  COTS  first  alternative, 
acquisition,  but  they  the  acquirer  can 
are  each  fraught  purchase  the 
their  own  servicing  infer- 

*  :  mation  support 

of  the  manufac¬ 
turer.  This  allows  the  CM  authority  to 
make  decisions  based  on  changes  to  the 
item.  If  the  CM  authority  knows  of  a 
manufacturer’s  changes  to  an  item,  they 
can  choose  to  acquire  a  replacement  or 
modify  the  system  as  required  to  allow 
continued  use  of  the  variant  item  (Defense 
Systems  Management  College,  1997). 

The  risks  involved  in  this  are  three. 


First,  when  an  item  changes,  there  is  the 
cost  to  acquire  and  certify  a  new  item  if 
the  decision  is  made  to  replace  it.  Second, 
there  is  the  cost  to  certify  and  possibly 
modify  the  system  if  the  item  is  retained. 
And  third,  there  is  the  cost  to  set  up  sup¬ 
port  if  a  decision  is  made  to  not  make  any 
changes  to  the  item.  The  advantages  of 


retention  or  replacement  are  the  contin¬ 
ued  COTS  logistics  tail  and  guaranteed 
item  certification.  System  recertification 
is  still  required.  If  the  item  is  retained  in 
its  original  configuration,  the  decision  to 
support  a  now  government-unique  item 
leads  to  a  typical  high-cost  government 
logistics  tail.  To  my  knowledge,  this  pick- 
and-choose  method  of  systems  support  has 
not  been  used  intentionally;  however,  after 
a  manufacturer  has  made  unexpected 
changes  to  a  COTS  component,  many 
programs  have  found  themselves  in  this 
situation. 

The  second  alternative  is  that  the 
acquirer  can  purchase  manufacturer 
support  for  the  item.  The  risks  in  this  are 
similar  to  that  of  purchasing  servicing 
information  support;  however,  the  manu¬ 
facturer  has  more  incentive  to  keep  the 
item  within  form,  fit,  and  interface  con¬ 
figuration  for  the  system.  When  changes 
in  the  system  are  required  to  support 
changes  in  the  item,  the  manufacturer  can 
aid  the  CM  authority.  This  is  a  very 
common  method  used  to  support  COTS. 

In  the  third  alternative,  the  acquirer  can 
purchase  the  full,  integrated  support  of  the 
manufacturer.  This  allows  the  manufac¬ 
turer  to  make  changes  to  the  system  along 
with  changes  to  the  item.  The  contractor 
may  have  some  total  system  performance 
responsibility  (TSPR),  but  the  CM  author¬ 
ity  must  still  recertify  the  system.  The  AC- 
130U  is  using  this  method  to  manage 
COTS  in  its  new  integrated  weapon  sys¬ 
tem  support  program.  This  is  the  most 
common  method  used  today  to  support 
COTS  items  and  systems  through  CLS. 

The  fourth  solution  is  for  the  acquirer 
to  purchase  full  system  support  that  would 
allow  an  integrator  to  automatically  make 
the  necessary  changes  to  the  system  to 
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accommodate  any  item  changes.  In  this 
scenario,  the  contractor  would  have 
TSPR  and  certify  the  weapon  system. 
This  fourth  option  is  used  now  prima¬ 
rily  to  support  FAA-certified  government 
aircraft.  It  could  potentially  be  used  to  sup¬ 
port  any  government  aircraft  or  system 
incorporating  COTS  items. 

The  message  should  be  plain.  COTS 
acquisitions  lead  the  acquirer  down  two 
support  paths:  the  government-unique 
high-cost  logistics  tail  and  the  COTS 
manufacturer  support  tail.  Both  paths 
involve  risk  and  guarantee  future  costs  for 
any  system  incorporating  COTS  items. 


The  potential  of  COTS  acquisitions  is 
embodied  in  a  lower  cost  development, 
initial  acquisition,  and  support  costs,  but 
that  potential  must  be  balanced  with  the 
knowledge  that  COTS  acquisitions  will 
either  force  modifications  and  recertifica¬ 
tions  or  lead  to  a  typical  government- 
unique  logistics  tail. 

COTS  for  aviation  isn’t  dead,  but  it  isn’t 
a  simple  solution  to  aircraft  and  aviation 
acquisitions.  It  requires  careful  planning 
and  forethought  that  must  be  incorporated 
into  any  program  contemplating  a  COTS 
acquisition. 
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Endnote 


1.  An  example  of  airworthiness  directives  can  be  viewed  at  www.safetydata.com 
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OPINION 


DEPOT  UTILIZATION  AND 
COMMERCIALIZATION 

William  N,  Washington 


The  excess  capacity  that  currently  exists  within  DoD  maintenance  depots 
presents  an  extra  burden  of  overhead  expenses.  The  remedies  fall  into  two 
categories.  The  first  represents  what  the  Services  have  been  doing  through 
the  base  realignment  and  closure  process:  closing  and  moving  workload  to 
the  fewer  remaining  depots.  The  second  approach  is  to  find  a  new  use  for 
the  depots  through  commercializing  their  facilities,  and  bringing  in  work  from 
outside  the  current  DoD  maintenance  system.  This  article  discusses  both 
proposed  solutions,  their  potential  problems,  and  the  changes  needed  to 
ensure  their  success. 


During  the  past  several  years,  the  De¬ 
partment  of  Defense  (DoD)  has 
been  involved  in  an  ongoing  effort 
to  reduce  costs  across  a  broad  range  of 
functional  areas.  One  of  these  has  been 
the  closure  and  consolidation  of  military 
repair  depots,  which  has  reduced  the  in¬ 
frastructure  and  overhead  costs  associated 
with  the  facilities.  But  this  process  has  not 
led  to  an  even  reduction  across  cost 
areas — ^the  military  workload  at  the  depots 
has  been  reduced  further  than  the  depot 
overhead  expenses  (Figure  1  [Leiby, 
1998]),  While  the  work  has  gone  away 
(variable  costs),  the  facilities  themselves 
still  have  expenses  that  are  not  tied  one- 
to-one  with  the  workload  (fixed  costs). 
Here  we  will  explore  this  situation,  and 


discuss  what  can  be  done  to  reduce  those 
costs. 

Military  repair  depots,  geared  to  per¬ 
form  unique  functions  that  in  many 
situations  are  not  available  in  the  private 
sector,  provide  specialized  repair  and 
support  for  defense  systems.  As  such,  their 
equipment  and  facilities  are  developed  to 
support  military  hardware  whose  require¬ 
ments  are  beyond  commercial  needs.  The 
military  has  sought  to  save  money  prima¬ 
rily  by  closing  existing  depots  and  trans¬ 
ferring  the  workload  to  remaining  instal¬ 
lations.  This  process  has  reduced  the 
number  of  major  Army  repair  depots  from 
10  to  5. 

But  the  remaining  Army  depots  are  not 
working  up  to  capacity,  and  so  there  is 
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room  for  additional  savings.  (Two  depots 
are  running  at  60  percent  utilization  and 
the  remainder  are  at  73-85  percent,  as  of 
February  1997  [Industrial  Operations 
Command  (IOC)  Briefing,  1998]).  These 
statistics  will  probably  worsen  with  time, 
with  the  reduced  need  for  military  repair 
(i.e.,  reduced  operations  tempo  and  num¬ 
ber  of  systems  maintained),  and  the 
significant  shift  in  new  weapon  system 
repair  designation  away  from  the  depots. 
(From  1987  to  1997,  the  military  has  made 
a  significant  effort  to  have  new  weapons 
systems  maintained  by  their  developer 
[General  Accounting  Office  (GAO)  (2), 
March  1998].)  The  latter  has  led  to  a 
significant  shift  in  responsibility:  In 
1987  75  percent  of  new  weapons  systems 
repairs  were  done  at  depots;  in  1997,  just 
18  percent  were. 

That  downward  momentum  is  likely  to 
continue;  the  gap  between  depot 
workload  and  capacity  requirements 
will  likely  increase.  The  political  reality 
is  that  further  depot  closings  are  not  in 


the  cards,  however;  so  we  should  consider 
expanding  their  use. 

Probuems  With  Consoubation 

ANB  PRIVITAZATIOH 


Previous  depot  consolidations  and  privat¬ 
izations  have  experienced  the  following: 

•  The  savings  did  not  materialize. 

•  Sufficient  information  was  not  avail¬ 
able  to  let  a  fixed-price  contract  for 
performing  the  mission. 

•  The  government-furnished  material 
needed  for  the  repair  process  was  not 
provided  in  a  timely  manner,  thus 
causing  contractor  cost  overruns  and 
lawsuits  for  damages. 

•  The  environmental  costs  of  cleaning  up 
the  facility  have  been  substantial,  and 
have  been  difficult  to  accurately  estimate. 
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In  addition,  one  must  review  several 
considerations  prior  to  closing  a  depot: 

•  Surge  capacity  must  be  retained  for 
wartime  requirements, 

•  Unique  hardware  can  be  expensive  to 
move,  and  may  not  function  properly 
in  other  geographic  areas  (such  as 
outdoor  test  sites). 

•  Legal  and  policy  barriers  may  prevent 
outsourcing  the  depot  work. 

Problems  with  privatization  and 
outsourcing  are  perhaps  the  greatest  draw¬ 
backs  in  trying  to  reduce  depot  costs,  as 
several  prior  government  privatization  and 
outsourcing  efforts  show  (Kitfield,  1998). 
For  example,  in  1995  the  Air  Force 
awarded  contracts  to  outsource  the  Aero¬ 
space  Guidance  and  Metrology  Center  at 
Newark  Air  Force  Base,  OH.  The  GAO 
study  on  this  effort  found  that  privatization 
of  the  center  would  not  generate  the  pro¬ 
jected  20-30  percent  savings.  In  fact,  the 
yearly  savings  were  so  minimal  that  it 
could  take  upwards  of  100  years  for  the 
Air  Force  to  achieve  that  magnitude  of 
savings  (Concannon,  1996,  and  GAO, 
December  1994). 

Just  recently,  GAO  was  asked  to  review 
a  new  Air  Force  interim  study  on  the 
project.  This  effort  indicated  the  minimal 
expected  savings  had  not  materialized, 
and,  in  fact,  the  outsourcing  was  costing 
the  Air  Force  16  percent  more  than  when 
it  ran  the  center  itself  (GAO,  December 
1997).  These  results  are  further  supported 
by  a  GAO  study  that  reviewed  public- 
private  competitions  on  depot  repair 
(GAO,  April  1996).  It  found  that  the 
depots  won  67  percent  of  the  competitions. 


with  depot  bids  averaging  40  percent  less 
than  the  private  sector. 

Further,  GAO  concluded  that  privati¬ 
zation  of  highly  skilled  technical  mainte¬ 
nance  performed  at  military  depots  may 
not  generate  the  expected  savings  due  to 
a  number  of  factors,  such  as  the  specific 
technical  nature  of  military  equipment,  the 
lack  of  competitive  private  sector  compa¬ 
nies  that  can  perform  these  jobs,  and  that 
the  reported  savings  on  previous  govern¬ 
ment  outsourcings  were  overoptimistic 
and  did  not  reflect  subsequent  cost  over¬ 
runs,  modifications,  or  add-ons  (GAO, 
July  1996;  GAO,  December  1996;  and 
GAO,  May  1997).  As  a  product  of  the  above 
uniqueness  of  military  depots,  GAO  also 
discussed  the  lack  of  adequate  competi¬ 
tion  to  reduce  costs. 

In  a  review  of  public-private  competi¬ 
tions  on  depot  repair,  the  GAO  (April 
1996)  found  that  for  23  percent  of  the  com¬ 
petitions  there 
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Further,  a  re¬ 
view  of  240  depot  maintenance  contracts 
showed  that  76  percent  of  them  were 
awarded  sole  source.  This  trend  seems  to 
be  worsening,  with  a  new  GAO  report 
(June,  1998)  indicating  that  DoD  is  now 
awarding  91  percent  of  the  current  depot 
contracts  (fiscal  year  1996-March  1997) 
noncompetitively,  mostly  to  the  original 
equipment  manufacturers,  since  the  gov¬ 
ernment  either  did  not  have  the  data  rights 
to  that  equipment,  or  could  not  precisely 
define  the  requirements  for  their  repair. 
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The  Army’s  sole-source  percentage 
appears  to  be  even  higher  than  the  DoD 
average,  with  95  percent  of  the  depot 
contracts  being  let  sole-source.  This  rep¬ 
resents  99  percent  of  the  total  dollar  value 
of  all  Army  depot  contracts.  This  situa¬ 
tion  is  worsened  by  the  fact  that  only  32 
percent  of  those  contracts  were  fixed  price, 
leaving  the  majority  of  them  subject  to 
possible  cost  increases. 

Part  of  the  problem  with  the  Newark 
outsourcing  was  that  the  Air  Force  lacked 
good  pricing  data  on  how  much  it  would 
cost  to  perform  the  missions.  As  a  conse¬ 
quence,  the  contractors  would  not  accept 
a  fixed-price  contract,  and  required  the  Air 
Force  to  use  a  cost  type  of  contract  (Val¬ 
ley,  1997).  Spaulding  (1997)  also  pointed 
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out  that  another 
reason  that  the 
cost  type  of  con¬ 
tract  was  selec¬ 
ted  for  Newark 
was  so  that  eq¬ 
uitable  treat¬ 
ment  of  former 
government 
employees  and 
unanticipated 


contractor  costs  could  be  provided.  This 


allowed  the  contractor  to  match  the 


government  benefits  that  existed  previ¬ 
ously  for  those  employees,  which  were 
higher  than  what  the  contractor  normally 
provided. 

In  terms  of  problems  with  moving 
depot  facilities,  the  recent  movement  of 
the  workload  at  Alameda  Naval  Aviation 


Depot  to  other  depots  (Jacksonville  Naval 
Aviation  Depot  and  San  Antonio  Air  Lo¬ 
gistics  Center)  produced  delays  and 
increased  costs  for  the  engine  repair  work 
that  was  transferred  (GAO  [1],  March 


1998).  These  problems  were  attributed  to 
conflicting  priorities  between  the  gaining 
and  losing  facilities,  unidentified  equip¬ 
ment  and  retooling  requirements,  limited 
access  to  cross-service  spare  parts,  out¬ 
dated  technical  data,  personnel  and  equip¬ 
ment  certification  requirements  not  being 
consistent,  and  shortfalls  in  the  number 
of  skilled  workers. 

Another  problem  the  Services  would 
want  to  avoid  is  what  occurred  at  Red 
River  Army  Depot  (RRAD),  where  the 
Base  Realignment  and  Closure  (BRAC) 
process  stripped  all  the  non-Bradley  Fight¬ 
ing  Vehicle  workload  from  the  depot. 
This  left  RRAD  initially  with  about  86 
percent  excess  capacity,  which  substan¬ 
tially  increased  their  operating  costs  by 
$15  per  hour,  due  to  fixed  costs  remain¬ 
ing  the  same  with  a  much  lower  workload 
over  which  to  spread  the  costs  (Newby, 
1997).  Some  of  these  costs  have  been 
brought  down  by  closing  or  tearing  down 
several  of  the  buildings  on  the  installation, 
but  it  still  remains  the  most  expensive 
Army  repair  facility. 

A  similar  situation  occurred  at  Newark 
(Spaulding,  1997)  when  it  was  privatized- 
in-place,  causing  its  rates  to  increase. 
These  findings  are  supported  by  several 
reports  (Defense  Science  Board  [DSB], 
1996;  GAO,  April  1996;  GAO  [1],  Sep¬ 
tember  1996;  GAO  [2],  September  1996) 
that  also  stress  the  problems  of  increased 
capacity  as  a  result  of  privatization-in¬ 
place.  For  instance,  the  GAO  found  that 
for  79  percent  of  the  contract  items  in  the 
Newark  privatization,  the  costs  had 
actually  increased,  causing  the  overall 
costs  to  have  a  net  increase  in  rates  of  $6 
million  (GAO,  April  1996). 

Lastly,  as  former  Rep.  Earl  Hutton,  then 
subcommittee  chairman  for  the  House 
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Readiness  Panel,  commented  on  the  move 
to  dismantle  the  depot  system:  “The 
organic  maintenance  capability  [of  the 
Defense  Dept.]  is  far  too  important  to  the 
readiness  of  the  forces  to  be  susceptible 
to  the  difficulties  being  experienced  by  the 
defense  industrial  base.”  “We  need  to  be 
careful  not  to  dismantle  a  capability  that 
will  risk  readiness  and  cost  billions  to 
reconstruct”  (Morrocco,  1994).  A  similar 
note  was  struck  by  former  Secretary  of  the 
Air  Force  Sheila  E.  Widnall  (“Widnall 
clarifies  depot  decision,”  March  1995), 
who  stated  that  “undertaking  large,  unbud¬ 
geted  efforts  like  depot  closures  would 
jeopardize  future  re-capitalization  and 
modernization  of  Air  Force  programs.” 

Given  these  considerations,  the  closure, 
outsourcing,  or  privatization  of  depot 
facilities  may  not  be  the  best  approach  to 
rectify  the  problem  of  underused  capacity 
at  this  time. 

CoMMiRCMuanow  of  Depots _ 

A  better  alternative  to  these  practices, 
in  our  current  environment,  would  be  to 
look  at  options  that  would  change  the  func¬ 
tion  of  the  depot,  so  that  we  would  retain 
surge  capacity  but  still  reduce  costs  by 
fully  utilizing  existing  facilities.  This 
alternative  is  in  keeping  with  the  DoD 
guidance  to  promote  commercialization  of 
military  depots  (DoD,  1996),  and  could 
be  two  forms. 

The  first  is  commercial  work.  A  recent 
GAO  Report  (May,  1998)  discusses  that 
these  types  of  arrangements  are  legal  under 
Title  10  of  the  U.S,  Code,  and  have  been 
successful  in  bringing  new  funds  to  the 
depots,  through  direct  sales  (in  which  the 
government  facility  acts  as  a  subcontractor 


for  private  industry),  and  through  work- 
share  (in  which  the  program  manager 
sends  funds  directly  to  the  depot  for  part 
of  the  work,  and  awards  a  contract  to 
private  industry  for  the  remaining  portion). 

The  second  is  cooperative  research  and 
development  agreements  (CRADAs)  for 
teaming  or  technology  transfer  projects 
with  small  businesses  receiving  govern¬ 
ment  grants,  universities,  and  government 
laboratories. 


Currently,  direct  sales  represent  about 
99  percent  of  the  external  work  being  per¬ 
formed  by  the  Army  depots  (Kopp,  1998); 
other  alternatives  could  provide  additional 
work  for  the  depots  that,  in  turn,  would 
bring  in  additional  funding,  and  reduce 
overhead  costs  for  all  the  depot’s  custom¬ 
ers,  both  military  and  commercial.  How¬ 
ever,  in  order  to  fairly  implement  a  com¬ 
mercialization  of  the  depots,  we  would 
need  to  institute  something  similar  to 
activity-based  costing  (ABC)  in  order  to 
assure  that  the  commercial  customers 
would  not  be  subsidized  by  the  govern¬ 
ment.  This  is  because  of  the  way  the  depots 
currently  keep 
track  of  costs, 
whichiUloca.es 
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for  pricing  of  specific  work  (this  concern 
about  adequate  pricing  of  depot  repairs  has 
also  been  voiced  by  the  Defense  Science 
Board’s  Report  on  Outsourcing  and 
Privatization  [DSB,  1996]). 

ABC  focuses  on  identifying  the  activi¬ 
ties  that  are  responsible  for  the  costs 
associated  with  a  product.  As  such,  activity 
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costs  are  passed  on  to  products  or  services 
only  if  the  product  or  service  uses  that 
particular  activity.  For  instance,  as  the 
number  of  activity  measures  increase  (i.e., 
functions  that  contribute  a  cost  to  a  prod¬ 
uct,  such  as  multiple  processing  steps, 
multiple  skill  levels  from  different  func¬ 
tional  areas,  multiple  machine  or  tooling 
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requirements, 
allocation  of 
overheads  to 
products  and  ser¬ 
vices  according 
to  the  demand  by 
each  activity), 
ABC  is  better 
able  to  capture 
the  underlying 
economics  of  the 
organiza-tion’s 
operations,  and 


identify  the  “true”  costs  (true  expenses  and 


unit  costs  by  service  line,  function,  and  cli¬ 


ent)  for  producing  a  product  or  repair  ac¬ 


tion. 


This  increased  visibility  into  the  cost 
of  performing  a  service  or  manufacturing 
an  item  has  been  very  popular  in  private 
industiy,  with  hundreds  of  articles  writ¬ 
ten  on  its  use  and  benefits.  In  other  words, 
there  should  be  a  firewall  between  projects 
performed  for  private  industry  and  regu¬ 
lar  Service  repair  workload,  so  that  the 
“true”  costs  of  performing  “outside  work” 
can  be  determined. 

The  teaming  and  technology  transfer 
projects  might  involve  several  aspects, 
ranging  from  just  commercial  work  to 
projects  with  technology  transfer  incuba¬ 
tors,  small  business  innovation  research 
(SBIR),  and  small  business  technology 
transfer  (STTR).  This  approach  could 
serve  as  a  bridge  between  commercial. 


government  and  university  research,  and 
development  and  production  applications 
(Washington,  1997);  and  could  incor¬ 
porate  existing  federal,  state  and  local 
funding  initiatives  on  promoting  small 
businesses  (which  in  1988  represented 
$550  million  to  promote  technology 
innovation  [Peterson,  1993]).  It  might  also 
tie  into  the  Services’  Centers  of  Excellence 
Programs  or  the  OSD-funded  university 
research  initiatives. 

These  programs  have  been  expanding 
somewhat  to  now  also  include  joint 
university-industry  research  projects 
(Gaumond,  1994),  and  the  Army  Research 
Laboratory’s  “federated  laboratory”  con¬ 
cept  (Army  Research  Laboratory,  1994). 
The  Advanced  Research  Projects  Agency 
(ARPA)  is  also  funding  engineering 
programs  through  its  Technology  Rein¬ 
vestment  Project  (TRP)  initiative,  in 
conjunction  with  the  National  Science 
Foundation  (Wax,  1995).  Through  these 
programs,  the  Services  leverage  the  best 
universities  in  the  nation  to  advance  the 
state  of  science  in  areas  of  interest  to  the 
military.  It  would  make  sense  for  our  depot 
system  to  join  in  this  process,  and  benefit 
not  only  these  existing  programs  but  our 
depots  as  well. 

Other  CoNSiPEMTioiis _ 

Dennis  Urban  (Urban,  1998)  at  the  U.S. 
Army  Industrial  Operations  Command 
(IOC)  has  mentioned  several  possible 
actions  that  might  also  be  taken  to  reduce 
costs  in  depots: 

•  Modernize  facilities,  so  they  are  more 
cost  effective  to  operate. 
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•  Move  processes  into  smaller  buildings 
on  the  depot  property,  and  close  the 
larger  buildings. 

•  Increase  training,  so  that  depot  person¬ 
nel  have  cross-skill  carryover  to  work 
on  multiple  types  of  projects. 

•  Sell  excess  equipment  that  is  not  used, 
or  only  marginally  used  (if  outside 
resources  exist  that  can  perform  the 
function  at  less  cost  than  maintaining 
the  equipment  [cost  plus  depreciation]). 


SUMMJWY  AHD  DISCUSSION 


The  commercialization  of  the  depots 
would  provide  small  businesses  and 
universities  with  an  applied  engineering 
program,  advanced  manufacturing  knowl¬ 
edge,  and  state-of-the-art  laboratory  and 
manufacturing  resources.  It  would  bring 
to  the  depots  outside  work  and  money  that 
would  lower  their  costs  by  fiilly  utilizing 
existing  personnel  and  facilities.  Further, 
through  working  with  other  government 
and  Service  programs  to  promote  technol¬ 
ogy  transfer  and  areas  of  science  of  inter¬ 
est  to  the  military,  it  would  help  both  these 
programs  and  the  depots. 

In  order  for  the  commercialization  of 
the  depot  process  to  proceed,  however,  it 
will  be  necessary  to  institute  an  ABC 
program  in  the  depots,  to  assure  that 
government  funds  are  not  subsidizing 
commercial  businesses,  especially  con¬ 
tractors  who  are  competing  with  one 
another  for  government  contracts.  In 
addition,  commercialization  will  have 
some  up-front  costs.  They  would  take  the 
form  of  costs  for  the  new  (ABC)  account¬ 
ing  system  and  the  costs  associated  with 


attracting  business  to  the  depots  (e.g., 
advertising,  transaction  costs). 

Lastly,  there  could  be  a  concern  about 
the  government  competing  with  private 
industry,  which  has  been  voiced  over  the 
past  couple  of  years,  as  other  government 
commercialization  efforts  have  ventured 
into  performing  outside  work.  However, 
taking  these  considerations  into  account, 
it  still  seems  that  the  most  viable  solution 
is  for  the  Services  to  commercialize  their 
depots.  This  effort  should  be  achievable  with 
minimum  costs  to  the  Services  and  should 
not  receive  significant  private  industry 
criticism  if  the  process  were  handled  as  a 
cooperative  versus  a  competitive  venture 
with  them. 

Several  of  the  DoD  laboratories  have 
pursued  this  strategy  over  the  past  few 
years,  though  not  always  successfully.  So 
significant  lessons  can  be  gleaned  from 
their  efforts  to 
commercialize  i 
their  facilities, 
such  as  what^ 
media  (e.g., 
trade  shows, 
journals,  etc.) 
have  served  as 
the  best  mecha¬ 
nism  for  attract¬ 
ing  industry ; 
participation. 

Secondly,  it 
may  be  easier  to 
interest  outside 

participants  in  having  work  performed  at 
depots  than  in  the  laboratories,  for  depots 
deal  with  the  basic  process  of  man¬ 
ufacturing,  rather  than  the  more  complex 
world  of  developing  new  systems  and 
materials.  The  feasibility  of  this  approach 
is  exemplified  by  several  initial  efforts 
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where  the  depots  have  already  formed 
contractual  agreements  to  manufacture 
components  for  industry  (Kopp,  1998). 

How  do  we  avoid  criticism  from  pri¬ 
vate  industry?  If  the  projects  brought  into 
the  depot  are  cooperative  ventures  with 
private  industry,  rather  than  competitions 
with  them,  criticism  should  be  minimized. 
These  cooperative  ventures  could  also 
offer  significant  cost  benefits  to  industry, 
for,  as  mentioned  earlier,  depots  have  been 
successful  in  their  competitions  with 
private  industry,  winning  67  percent  of  the 


competitions,  and  with  costs  averaging  40 
percent  less  (GAO,  April  1996). 

Commercialization  of  military  depots 
would  seem  to  be  a  viable  solution  to  the 
problem  of  increasing  overhead  costs  and 
underuse  of  depot  facilities.  The  commer¬ 
cialization  of  the  depots  could  also  provide 
both  industry  and  universities  with  sev¬ 
eral  benefits,  such  as  an  applied  engineer¬ 
ing  program,  advanced  manufacturing 
knowledge,  and  state-of-the-art  laboratory 
and  manufacturing  resources. 
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The  Acquisition  Review  Quarterly 
(ARQ)  is  a  scholarly  peer-reviewed  jour¬ 
nal  published  by  the  Defense  Acquisition 
University.  All  submissions  receive  a 
masked  review  to  ensure  impartial  evalu¬ 
ation. 


Submissions 


Submissions  are  welcomed  from  any¬ 
one  involved  in  the  Defense  acquisition 
process.  Defense  acquisition  is  defined  as 
the  conceptualization,  initiation,  design, 
development,  test,  contracting,  produc¬ 
tion,  deployment,  logistic  support,  modi¬ 
fication,  and  disposal  of  weapons  and 
other  systems,  supplies,  or  services  to  sat¬ 
isfy  Defense  Department  needs,  or  in¬ 
tended  for  use  in  support  of  military  mis¬ 
sions. 


Research  Articles 


Manuscripts  should  reflect  research  or 
empirically-supported  experience  in  one 
or  more  of  the  aforementioned  areas  of 
acquisition.  Research  or  tutorial  articles 
should  not  exceed  4,500  words.  Opinion 
pieces  should  be  limited  to  1,500  words. 

We  publish  Defense  Acquisition  re¬ 
search  articles  that  involve  systemic  in¬ 


quiry  into  a  significant  research  question. 
The  article  must  produce  a  new  or  revised 
theory  of  interest  to  the  acquisition  com¬ 
munity.  You  must  use  a  reliable,  valid  in¬ 
strument  to  provide  your  measured  out¬ 
comes. 


Manuscript  Sections 


The  introduction  should  state  the  pur¬ 
pose  of  the  article  and  concisely  summa¬ 
rize  the  rationale  for  the  undertaking. 

The  methods  section  should  include  a 
detailed  methodology  that  clearly  de¬ 
scribes  work  performed.  Although  it  is 
appropriate  to  refer  to  previous  publica¬ 
tions  in  this  section,  the  author  should  pro¬ 
vide  enough  information  so  that  the  expe¬ 
rienced  reader  need  not  read  earlier  works 
to  gain  understanding  of  the  methodology. 

The  results  section  should  concisely 
summarize  findings  of  the  research  and 
follow  the  train  of  thought  established  in 
the  methods  section.  This  section  should 
not  refer  to  previous  publications,  but 
should  be  devoted  solely  to  the  current 
findings  of  the  author. 

The  discussion  section  should  empha¬ 
size  the  major  findings  of  the  study  and 
its  significance.  Information  presented  in 
the  aforementioned  sections  should  not  be 
repeated. 
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Research  Considerations 


Contributors  should  also  consider  the 
following  questions  in  reviewing  their  re¬ 
search-based  articles  prior  to  submission: 

•  Is  the  research  question  significant? 

•  Are  research  instruments  reliable  and 
valid? 

•  Are  outcomes  measured  in  a  way 
clearly  related  to  the  variables  under 
study? 

•  Does  the  research  design  fully  and  un¬ 
ambiguously  test  the  hypothesis? 

•  Did  you  build  needed  controls  into  the 
study? 

Contributors  of  research-based  submis¬ 
sions  are  also  reminded  they  should  share 
any  materials  and  methodology  necessary 
to  verify  their  conclusions. 

Criteria  FOR  Tutorials 


Tutorials  should  provide  special  in¬ 
struction  or  knowledge  relevant  to  an  area 
of  defense  acquisition  to  inform  the  De¬ 
fense  Acquisition  Workforce. 

Topics  for  submissions  should  rely  on 
or  be  derived  from  observation  or  experi¬ 
ment,  rather  than  theory.  The  submission 
should  provide  knowledge  in  a  particular 
area  for  a  particular  purpose. 


Opinion  Criteria 


Opinion  articles  should  reflect  judg¬ 
ments  based  on  the  special  knowledge  of 
the  expert.  Opinion  articles  should  be 
based  on  observable  phenomena  and  pre¬ 
sented  in  a  factual  manner;  that  is,  sub¬ 
missions  should  imply  detachment.  The 
observation  and  Judgment  should  not  re¬ 
flect  the  author’s  personal  feelings  or 
thoughts.  Nevertheless,  opinion  pieces 
should  clearly  express  a  fresh  point  of 
view,  rather  than  negatively  criticize  the 
view  of  another  previous  author. 

Manuscript  Style 


We  will  require  you  to  recast  your  last 
version  of  the  manuscript,  especially  ci¬ 
tations  (e.g.,  footnotes  or  endnotes)  into 
the  format  required  in  two  specific  style 
manuals.  The  ARQ  follows  the  author 
(date)  form  of  citation.  We  expect  you  to 
use  the  Publication  Manual  of  the  Ameri¬ 
can  Psychological  Association  (4th  Edi¬ 
tion),  and  the  Chicago  Manual  of  Style 
(14th  Edition).  The  ARQ  follows  the  au¬ 
thor  (date)  form  of  citation. 

Contributors  are  encouraged  to  seek  the 
advice  of  a  reference  librarian  in  complet¬ 
ing  citations  of  government  documents. 
Standard  formulas  of  citations  may  give 
only  incomplete  information  in  reference 
to  government  works.  Helpful  guidance 
is  also  available  in  Gamer,  D.L.  and  Smith, 
D.H.,  1993,  The  Complete  Guide  to  Cit¬ 
ing  Government  Documents:  A  Manual 
for  Writers  and  Librarians  (Rev.  Ed.), 
Bethesda,  MD:  Congressional  Informa¬ 
tion  Service,  Inc. 
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Copyright  Information 


The  ARQ  is  a  publication  of  the  United 
States  Government  and  as  such  is  not 
copyrighted.  Contributors  of  copyrighted 
works  and  copyright  holders  of  works  for 
hire  are  strongly  encouraged  to  request  that 
a  copyright  notification  be  placed  on  their 
published  work  as  a  safeguard  against 
unintentional  infringement.  The  work  of 
federal  employees  undertaken  as  part  of 
their  official  duties  is  not  subject  to  copy¬ 
right. 

In  citing  the  work  of  others,  it  is  the 
contributor’s  responsibility  to  obtain  per¬ 
mission  from  a  copyright  holder  if  the  pro¬ 
posed  use  exceeds  the  fair  use  provisions 
of  the  law  (see  U.S.  Government  Printing 
Office,  1994,  Circular  92:  Copyright  Law 
of  the  United  States  of  America,  p.  15, 
Washington,  DC:  Author).  Contributors 
will  be  required  to  submit  a  copy  of  the 
written  permission  to  the  editor  before 
publication. 


Manuscript  Format 


Pages  should  be  double-spaced  and  or¬ 
ganized  in  the  following  order:  title  page, 
abstract,  body,  reference  list,  author’s  note 
(if  any),  and  figures  or  tables.  To  ensure 
anonymity,  each  paper  should  be  submit¬ 
ted  with  a  separate  page  that  includes  the 
author(s)’s  name(s)  and  complete  address, 
and  the  paper  should  include  the  title,  ab¬ 
stract,  keywords,  body,  complete  set  of 
references,  along  with  tables  and  figures 
at  the  end.  Authors  are  reminded  not  to 
refer  to  themselves  or  to  their  own  work 
directly  in  the  paper.  Figures  or  tables 
should  not  be  inserted  (or  embedded,  etc.) 


into  the  text,  but  segregated  one  to  a  page 
following  the  text.  Articles  must  be  print¬ 
able  within  one  issue  and  should  not  ex¬ 
ceed  4,500  words  for  research  or  tutorials 
and  1,500  words  for  opinion  pieces;  ar¬ 
ticles  will  not  be  printed  in  parts  or  in  a 
continuing  series.  If  material  is  submitted 
on  a  computer  diskette,  each  figure  or  table 
should  be  recorded  in  a  separate,  export¬ 
able  file  (i.e.,  a  readable  .eps  file).  For 
additional  information  on  the  preparation 
of  figures  or  tables,  see  CBE  Scientific 
Illustration  Committee,  1988,  Illustrating 
Science:  Standards  for  Publication, 
Bethesda,  MD:  Council  of  Biology  Edi¬ 
tors,  Inc.  Please  restructure  briefing  charts 
and  slides  to  a  look  similar  to  those  in  pre¬ 
vious  issues  of  ARQ. 

The  author  (or  corresponding  author  in 
the  case  of  multiple  authorship)  should 
attach  to  the  manuscript  a  signed  cover 
letter  that  provides  the  author’s  name,  ad¬ 
dress,  and  telephone  number  (fax  and 
Internet  addresses  are  also  appreciated). 
The  letter  should  verify  that  the  submis¬ 
sion  is  an  original  product  of  the  author; 
that  it  has  not  been  published  before;  and 
that  it  is  not  under  consideration  by 
another  publication.  Details  about  the 
manuscript  should  also  be  included  in  this 
letter:  for  example,  its  title,  word  length, 
the  need  for  copyright  notification,  the 
identification  of  copyrighted  material  for 
which  permission  must  be  obtained,  a 
description  of  the  computer  application 
programs  and  file  names  used  on  enclosed 
diskettes,  etc.  A  short  biography  of  no 
more  than  75  words  and  a  photo  of  the 
author  will  be  expected  from  each  author. 
Author  names  and  e-mail  addresses  are  not 
part  of  the  75-word  count. 

The  letter,  one  copy  of  the  printed 
manuscript,  and  any  diskettes  should  be 
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sturdily  packaged  and  mailed  to:  Defense 
Systems  Management  College,  Attn: 
DSMC  Press  (ARQ),  9820  Belvoir  Road, 
Suite  3,  Fort  Belvoir,  VA  22060-5565. 

In  most  cases,  the  author  will  be  noti¬ 
fied  that  the  submission  has  been  received 
within  48  hours  of  its  arrival.  Following 
an  initial  review,  submissions  will  be  re¬ 
ferred  to  referees  and  subsequent  consid¬ 
eration  by  the  ARQ  Editorial  Board. 


Contributors  may  direct  their  questions 
to  the  Editor,  ARQ,  at  the  address  shown 
above,  by  calling  (703)  805-4290  (fax 
805-  2917),  or  via  the  Internet  at: 
gonzalezd@dsmc.dsm.mil. 

The  DSMC  Home  Page  can  be  accessed 
at: 

http://www.dsmc.dsm.mil. 
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We  welcome  letters  to  the  editor.  Please  send  to:  Department  of 
Defense,  Defense  Systems  Management  College,  ATTN:  DSMC  Press, 
9820  Bel  voir  Road,  Suite  3,  Fort  Belvoir,  VA  22060-5565. 


From: 

Rear  Admiral  Rowland  G.  Freeman  III,  USN  (Ret) 
1901  Patriots  Colony  Drive 
Patriots  Colony 
Williamsburg,  VA  22124 


Mon,  May  17,  1999 

In  a  recent  issue  of  Acquisition  Review  Quarterly,^  two  articles  appeared  which  had  a 
common  thesis:  It  is  possible  to  determine/project  with  some  certitude  the  success 
factors  for  acquisition  programs.  One  study  sought  to  identify  factors  that  contribute  to 
program  success.^  The  second  article  had  as  its  central  thought  that  the  use  of  critical 
success  factors  in  the  development  of  critical  management  information  systems  for  the 
DoD  program  manager  would  have  significant  benefit.^  In  both  articles,  the  selection  of 
the  program  management  databases  raises  a  number  of  questions. 

What  is  Missing? 

Of  note  are  the  factors  not  considered  significant  in  the  data,  such  as  technical  diffi¬ 
culty  (this  has  been  the  most  significant  factor  in  program  failure  or  success  and  gave 
rise  to  Dr.  John  Foster’s  Unknown-  Unknowns  when  he  was  Director  of  Defense  Research 
and  Engineering  (DDR&E)).  No  mention  is  made  of  the  contract,  which  is  the  primary 
interface  between  government  and  industry,  and  has  been  the  cause  of  much  program 
disruption  (C-5,  F-111,  Army  Helicopter,  F-14,  DD-963).  Proper  contract  administra- 


‘  Acquisition  Review  Quarterly,  Volume  5,  No.  1,  Winter  1998. 

-  Maj.  Kenneth  J.  Delano,  USAF,  Identifying  Factors  That  Contribute  to  Program  Success,  1989. 

^  James  H.  Dobbins  and  Richard  G.  Donnelly,  Ph.D.,  Summary  Research  Report  on  Critical  Success  Factors  in  Federal 
Government  Program  Management,  1998. 
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tion  can  make  or  break  a  program.  More  of  concern  was  the  statement  in  the  first  article 
“Judged  least  important  were  meeting  logistics  supportability  objectives..,.” 

Since  logistic  support  is  between  60%  and  80%  of  the  cost  of  a  system  and  without 
it  or  even  with  marginal  support,  systems  fail.  Something  is  amiss  in  the  training  and 
education  of  our  program  managers  if  logistics  has  no  recognized  priority.  Perhaps  an 
inspection  of  today’s  cannibalized  aircraft  or  other  systems  used  to  keep  others  operat¬ 
ing  might  be  a  good  object  lesson.  No  mention  in  the  first  study  is  made  of  today’s  most 
recognized  success  factor  and  that  is  the  management  information  system  and  the 
accompanying  diagnostic  expert  system.  The  second  study  has  it  as  the  number  one 
success  factor.  Given  the  advances  in  risk  management,  an  essential  factor  in  successful 
programs,  it  is  hard  to  believe  that  the  first  study  does  not  include  it,  and  it  ranks 
number  10  in  the  second  study.  Lastly,  no  mention  is  made  of  one  of  the  most  difficult 
barriers  to  a  successful  program;  transition  from  development  to  production. 

It  is  believed  that  from  the  data  provided  by  the  two  articles,  M  the  items  listed  have 
a  high  priority  to  an  individual  PM;  (a)  depending  on  a  his  or  her  experience,  (b)  where 
the  program  was  in  its  cycle  when  the  survey  was  accomplished,  (c)  the  level  of  PM 
training,  (d)  the  level  of  technical  difficulty  of  the  program. 

Where  We  Have  Been 

The  first  substantive  investigation  of  defense  procurement  was  the  Truman  Commit¬ 
tee  in  the  40’s  after  WWII.  This  effort  was  primarily  focused  on  corruption.  With  the 
creation  of  the  Defense  Department  under  James  Forrestal,  there  was  a  major  push  to 
bring  order  out  of  chaos;  however,  procurement  problems  during  the  Korean  conflict 
demonstrated  that  much  remained  to  be  done.  In  the  late  50’s  after  extensive  testimony 
from  all  the  services,  the  Blue  Ribbon  panel  was  created,  and  the  results  were  more 
regulation  and  laws  plus  an  effort  to  professionalize  both  the  contracting  field  and  the 
program  managers.  Its  results  were  limited.  The  McNamara  Initiatives  in  1961  brought 
zero  based  budgeting,  cost  effectiveness,  and  other  financial  legerdemain,  again  with 
limited  results  in  improving  the  probability  of  program  success. 

More  Studies 

Then  the  flood  started'^:  The  Fitzhugh  Commission  (1970),  The  Commission  on 
Government  Procurement  (1972),  the  issuance  of  0MB  Circular  109  (1976),  Defense 
Science  Board  Acquisition  Cycle  Study  (1978),  Defense  Resource  Management  Study 
(1979),  Defense  Acquisition  Improvement  Program  (1981),  Grace  Commission  (1983), 
Packard  Commission  (1986),  Goldwater-Nichols  Defense  Reorganization  Act  (1986), 
Defense  Management  Review  (1989)  Reinvention  Initiatives  1992-?.  There  was  a  com¬ 
mon  thread  in  the  recommendations  of  these  various  panels  as  it  pertained  to  the  attributes 
for  successful  programs.  These  are  best  exemplified  by  the  Packard  Commission’s 
“Acquisition  Model  To  Emulate.”  The  features  are  (1)  clear  command  channels,  (2) 


*  GAO/NSIAD-93- 15/December  1992,  Weapons  Acquisition,  A  Rare  Opportunity  for  Lasting  Change. 
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stability,  (3)  limited  reporting  requirements,  (4)  small  high  quality  staffs,  (5) 
communication  with  users,  and  (6)  prototyping  and  testing. 

Add  Management  Theory 

In  the  meantime,  many  new  management  theories  were  put  forth  to  try  and  improve 
the  opportunity  for  program  success;  Best  Practices,  Successful  Companies,  Total  Quality 
Management,  Total  Quality  Leadership,  Drs.  Demming  and  Juran,  Cost  Schedule  and 
Performance  Measurement,  Zero  Based  Budgeting,  Zero  Defects,  Theory  X,  Theory  Y, 
Theory  Z,  Milestones,  Inch  Stones,  Critical  Path  Analysis,  Management  by  Objectives, 
Fly  before  Buy,  Technology  on  the  Shelf,  No  Concurrency,  Concurrent  Engineering, 
Reinventing  the  Government,  and  the  list  goes  on.  Useful  theory,  but  each  requires 
careful  application  and  results  analysis. 

Results 

Our  program  success  rate  has  not  greatly  improved,  lead  time  remains  excessive,  the 
drive  for  new  untried  technology  still  remains  arid  delays  new  systems  as  unk-unks 
come  to  haunt  the  acquisition.  Cost  overruns  are  still  with  us  (see  Everglades  rehabili¬ 
tation  project),  and  we  ignore  history  as  did  the  program  managers  in  the  first  study 
(logistic  support  in  the  Balkans).  Both  the  Committees’  of  Congress  and  the  General 
Accounting  Office  is  a  tremendous  repository  of  corporate  memory.  The  GAO  has 
issued  over  900  reports  and  testimonies  on  virtually  all  aspects  of  the  weapons  system 
acquisition  process.^  These  are  quality  reports  even  where  there  are  disagreements  on 
recommendations.  They  should  not  be  ignored.  The  staffs  in  the  hill  Congress  reviewed 
many  acquisition  successes  and  failures,  sharing  knowledge  with  them  can  save  later 
problems,  and  to  ignore  them  is  to  do  so  at  your  peril.  It  seems  we  continue  to  look  for 
a  silver  bullet  or  perhaps  several,  but  perhaps  history  provides  better  clues. 

How  Do  We  Get  There  From  Here 

The  common  cry  of  a  troubled  program  manager  normally  is  to  blame  the  big  three 
to  which  most  management  problems  are  addressed;  “If  I  only  had  more  funds,  or  if  I 
could  only  get  good  people,  or  if  this  program  was  only  stable.”  Programs  do  not  al¬ 
ways  work  that  way.  In  the  competitive  economic  environment  in  which  we  operate, 
there  is  always  competition  for  funds,  and  also  always  short  falls.  The  same  holds  true 
of  people  and  program  stability. 

FBM  Program 

The  Fleet  Ballistic  Missile  program  was  a  success  not  only  because  it  met  the  Packard 
Commission  model  before  the  model  was  even  articulated,  but  also  because  it  followed 
significant  management  practices:  open  communication,  independent  internal  evalua¬ 
tion,  on-site  management  representation  at  contractor  plants,  strict  configuration 


5  GAO/NSIAD93-15/December  1992. 
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management  for  approved  designs  and  manufacturing  processes,  and  incentive  con¬ 
tracting  at  the  prime  level  and  extensive  competition  at  the  subcontract  level  It  is 
interesting  to  note  that  the  average  tenure  of  the  Program  Manager  was  years  and  for 
40%  of  civilian  personnel  over  10  years7  The  PMs  were  men  of  outstanding  technical 
and  management  capability. 

Some  Lessons  and  a  Proposal 

Program  success  factors  are  many  and  varied  and  no  one  set  suits  all  programs.  It  is 
evident  that  the  discipline  of  management,  supported  by  an  extensive  information  system, 
coupled  with  an  expert  IT  system  to  pick  out  areas  that  need  attention,  is  a  start.  Each 
Program  should  be  supported  by  modeling  and  simulation.  Starting  with  the  manage¬ 
ment  discipline,  it  is  apparent  that  the  application  of  the  principles  of  Systems  Engineering 
should  be  applied  to  all  programs.  Unfortunately  most  PMs  have  not  been  trained  in 
Systems  Engineering,  and  the  training  received  at  DoD  Schools  such  as  the  Defense 
Acquisition  University  do  not  emphasize  this,  but  rather  group  training  in  many  short 
courses. 

An  excellent  management  information  system  is  the  second  ingredient.  The  Com¬ 
puter  Aided  Acquisition  and  Logistics  Program  has  been  in  existence  for  over  ten  years 
but  how  many  program  managers  incorporate  it  in  their  programs?  An  excellent  Program 
Manager  Manual  HBK  59  exists,  we  have  gone  a  long  way  with  automated  manuals. 
The  Contractor  Integrated  Technical  Information  System  (CITIS)  specification  exists, 
and  provides  an  excellent  basis  for  data  exchange  with  the  contractor.  A  review  of  the 
outstanding  MIS  program  for  the  disposal  of  hazardous  material  at  Rocky  Flats  is  a 
good  model  for  the  complex  programs.  There  are  many  excellent  simulation  and  mod¬ 
eling  programs  available  that  it  is  a  shame  more  managers  do  not  take  advantage  of 
them,  at  the  minimum  use  they  use  as  an  excellent  staff  training  tool. 

A  program  manager  must  keep  Business  Management  and  Technical  Management 
in  balance  and  a  well  developed  MIS  system  can  aide  in  this  process.  The  Programs 
Strategic  Plan  using  the  Systems  Engineering  Process  will  not  guarantee  success,  but  it 
provides  a  tried  and  true  technique  for  program  management  and  a  discipline  for  the 
program  staff.  Each  program  is  different,  has  different  goals  and  objectives,  and  vary¬ 
ing  critical  areas  which  can  change  with  the  next  fax  or  e-mail.  Recognizing  what  is 
important  is  the  PM’s  first  priority,  and  the  data  system  should  be  defined  for  his  needs, 
incorporating  the  factors  that  he  and  his  contractors  are  critical,  modifying  them  over 
time  and  base  lining  these  against  the  contract  provisions  so  that  he  remains  within  its 
framework.  It  is  unfortunate  that  the  PM  will  seldom  be  around  when  20/20  hindsight 
is  used  to  determine  the  program’s  success,  but  he  can  console  himself  with  the 
understanding  that  if  he  was  promoted  for  his  efforts  and  the  program  subsequently 
failed,  he  avoided  the  well  known  stages  of  many  programs  which  are;  enthusiasm. 


‘  GAO/NSIAD-90-I60  Defense  Acquisition.  Reet  Ballistic  Program  Offers  Lessons  for  Successful  Programs. 
Ubid. 
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disenchantment,  panic,  search  for  the  guilty,  punishment  of  the  innocent,  and  decoration 
of  all  those  who  took  no  part. 

End  Notes 

There  are  many  fine  volumes  on  management,  and  when  frustration  grows  in  a  pro¬ 
gram  manager,  he  should  read  one  or  more  of  the  following:  Up  The  Organization  by 
Robert  Townsend,  Parkinson’s  Law  by  C.  Northcote  Parkinson,  The  Peter  Principle  by 
Lawrence  Peter,  The  Peter  Prescription  by  Lawrence  Peter,  Self  Renewal  by  John  Gardner, 
Five  Golden  Rings  by  Miyamoto  Musashi,  and  Augustine’s  Laws  by  Norman  R. 
Augustine. 

There  is  no  cookbook  for  successful  acquisition  management.  The  system  delivered 
to  the  operating  forces  must  work  and  be  well  supported  and  remember  it  must  be 
operated  by  people.  In  the  words  of  Admiral  Jellico  at  the  Battle  of  Jutland — “The 
prelude  to  battle  is  the  work  of  the  engine  room” — and  so  it  is  with  the  program  manager. 

This  is  a  longer  than  desired  critique,  but  the  authors  had  at  least  twice  the  volume, 
and  the  body  of  historical  data  is  very  large,  but  seldom  reviewed  or  really  explored.  It 
would  be  an  interesting  research  effort  to  really  try  and  define  the  boundaries  of  successful 
project/programs  (military  and  Civilian)  over  the  last  three  decades. 

Very  respectfully. 

Rear  Admiral  Rowland  G.  Freeman  III,  USN  (Ret) 
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